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PREFACE 


This book is in part a consequence of a long series of irritations on the 
part of the senior author. During the course of years he encountered 
too often tables of unsmoothed values, tables without descriptive legends 
or with inadequate legends, graphs with poorly chosen coordinate 
scales, graphs without accompanying descriptive legends and occasion¬ 
ally without indication as to what the coordinates themselves repre¬ 
sented, references to the significance of a so-called knee of a curve when 
the location of the knee was a function of the chosen coordinate scales, 
lack of understanding of how to determine, to express, and to apply 
precision indexes, blind faith in a least squares computation regardless 
of the assumptions and limitations, and many other faults which may 
be remedied with reasonable effort. For several years, this author has 
offered a course for graduate students entitled Treatment of Experimental 
Data in which such matters among others have been discussed. The 
present textbook is an outgrowth of that course. 

This book has been written with the physicist, the chemist, and the 
engineer in mind. The authors feel that, for a very large percentage of 
them, the book has a worth-while message. Although obviously the 
discussions are necessarily rather mathematical, considerable effort 
has been made to keep physical situations in mind throughout. 

We have generally steered away from the statistical treatment of 
quantum mechanics on the one hand and of business and educational 
theory on the other hand. We do, however, include a chapter on 
correlation. 

As determinants shorten and simplify many treatments, they have 
been used in discussions wherever convenient. Recognizing, however, 
that many users of this text may need to have their memories refreshed 
with regard to methods of use, A Brief Discussioji of Determinant 
Methods has been included as Appendix 1. Ir^4he discussion there given, 
particular attention has been paid to the pi^cesses of setting up, simpli¬ 
fying, and evaluating and to their application in solving simultaneous 
equations and in determining the equations of curves. The convenience 
obtained and the time saved by the use of determinants should be 
better known. 

The text, despite much care, probably contains many errors. Some 

of them undoubtedly reflect lack of knowledge on the part of the authors. 

• • • 

in 



IV 


PREFACE 


others have crept in by various paths. Whatever their origins, u id 
hoped that those who discover them will be kind enough to notify the 
authors. 


Pittsburgh, Pa. 
May 1943 


A. G. Worthing 
Joseph Geffner 
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SYMBOLS FREQUENTLY USED IN DISCUSSIONS OF 
METHOD TOGETHER WITH THEIR MEANINGS 


[Symbols concerned with Fourier Series expansions are defined at appropriate places in Chapter V) 
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Y, y, yi, V 2 , etc. j 
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Z, z, z u z 2 , etc. J 
Z 
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<T> <ry, etc. 


Average deviations for a single reading and for the means X, Y, 
etc. 

Frequency of occurrence of a particular value in a series of 
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Modulus of precision for a single reading and for the means 
X, Y, etc. 

Least squares factors entering Cox and Matuschak Tables. 
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Number of items in a series under consideration. 
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Standard error_of estimate of Y of the regression line of Y on X. 
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because of the skew distribution of the latter quantity. 
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CHAPTER I 


REPRESENTATION OF DATA BY TABLES 

1. Introduction. All of us, whether we realize it or not, are contin¬ 
ually making measurements. Such actions as noting the time of day, 
weighing oneself, and feeling the temperature of a tub of water with 
one’s hand or foot are typical commonplace observations. Usually the 
results of such observations are easily obtained, of little consequence, 
and soon forgotten. However, measurements made by a tailor in fitting 
a suit of clothes, a physician in diagnosing a disease, or a physicist in 
measuring the speed of light are of greater significance. Here the accu¬ 
racy of the measurements is a matter of concern; and it is often neces¬ 
sary that the measurements be anatyzed to obtain the desired final 
result. It is usually important that the results be preserved, at least 
temporarily; and it is desirable to present them in a form convenient for 
use and readily understood by others. It is with such problems that 
this book is concerned. 

All data, unless scattered, are encountered and dealt with in the form 
of tables, graphs, or equations. It is appropriate, therefore, that we 
begin with a discussion of these three devices for representing data, 
pointing out the advantages and disadvantages of each, describing the 
rules for their proper usage, and illustrating the applications for which 
each is best suited. Since original data are usually first tabulated, then 
graphed, and finally perhaps expressed as equations, we consider first 
the methods and principles of tabular representation. 

All measurements involve at least two variables, one assumed inde¬ 
pendent and the other dependent. In the simplest measurements, the 
independent variable is ignored. Thus, recognizing the fact that apples, 
on standing, lose weight by evaporation of water through the skins, we 
may consider the weight of a bag of apples as a function of the time 
elapsed since picking. Generally, though, the observation that a bag 
of apples weighs 5 pounds contains all the information desired; it adds 
nothing to specify the time, the independent variable. More often, we 
are interested in both dependent and independent variables, and fre¬ 
quently in the relationship between them. In the tabular representa¬ 
tion of data, the assumed dependent and independent variables and their 
relationship—if one exists—are expressed by listing corresponding values 

1 
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or properties of the variables in an orderly arrangement. As illustrated 
by newspaper radio programs, stock-market reports, railroad timetables, 
logarithm tables, and trigonometric tables, there are many types. 

In this chapter we shall first discuss the general advantages of tables, 
and then give the structural forms of each of three types. Specific rules 
are included for the construction of the one showing y = /(.r), together 
with two simple methods of smoothing data. The important problem 
of interpolation is discussed, and several interpolation formulas are de¬ 
veloped and illustrated. The chapter concludes with a discussion of 
extrapolation. 

2. Advantages of Tables. In favor of tables generally, it may be said 
that (a) they are simple and inexpensive to construct, requiring no 
special types of paper, curve forms, etc.; ( b ) they permit easy reference 
to data; (c) they facilitate comparisons of values, and ( d ) they provide 
a compact form for filing. In certain applications they possess special 
advantages. Thus, a table may show variations for several dependent 
variables as satisfactorily as for just one. It would be difficult to pre¬ 
sent the same data on a single graph without confusion. The table is 
generally preferable to the graph for presenting data which may be 
classified and subclassified in various ways. Finally, when the table is 
of the type showing y = /(.r), the element/(.r) can often be differentiated 
or integrated directly from the table to the desired accuracy without 
knowledge of its mathematical form, and with less labor than is involved 
when a graph is used. 

3. Types of Tables. Tables may be grouped into three general 
classes. The first and least important class—the qualitative class— 
contains those tables which relate quantities in a qualitative way. 
Table I is a typical example. Its construction and interpretation are 
sufficiently simple to require no explanation. The occurrence of the 
qualitative table is relatively infrequent despite the fact that it contains 
data which cannot be well presented in any other way. 

The second class of tables—the statistical class—contains tables in 
which some of the variables are expressed quantitatively, while others, 
usually including the variable assumed independent, are not. (See 
Table II.) This class includes most statistical tables such as those in 
the World Almanac and U. S. Census reports, tables of equivalents, and 
the periodic table of the chemical elements. 

The third class of tables—the functional class—is composed of tables 
which show one or more relations of the type y = f(x). Table III is a 
typical example. 

We are here principally concerned with the construction and inter¬ 
pretation of tables of the second and third classes. 
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TABLE I. An Example of the Qualitative Type of Table 

Parallelism of Physical Theories 1 


theories of light 

1. Corpuscular Theory: 

Corpuscles obey Newton’s laws of me¬ 
chanics. 

2. Modified Corpuscular Theory of Planck 
and Einstein: 

Quantum laws govern the behavior of 
photons. 

3. Wave Theory: 

Theory deals with continuous waves, 
yielding interference and diffraction ef¬ 
fects. Standing waves produced by in¬ 
terference correspond to quantization. 
No mention of particles. 

4. Einstein's i( Ghost Field” Interpretation: 
Interpretation reconciles corpuscular 

and wave theories . . . 

1 Physics Staff of the University of Pittsburgh, -• 
York, John Wiley & Sons, 1937. 


THEORIES OF MATTER 

1. Corpuscular Theory: 

Particles obey Newton’s laws of me¬ 
chanics. 

2. Modified Corpuscular Theory of Hei¬ 
senberg: 

Quantum laws govern the behavior of 
particles. 

3. Wave Theory: 

Theory deals with continuous waves, 
yielding interference and diffraction ef¬ 
fects. Quantization . . . corresponds to 
standing waves. No mention of particles 
in certain extreme forms of the theory. 

4. Born’8 Probability Interpretation: 
Interpretation reconciles corpuscular 

and wave theories . . . 

n Outline of Atomic Physics, p. 142, 2nd Ed., New 


TABLE II. An Example of the Statistical Type of Table 


Certain Elements of the Solar System 1 


Name 

Mean Dist. 
from Sun 
in 10 6 Km. 

Period 

Mass 


Relative 

Surface 

Gravity 

in Years 

Mass of Earth 

Sun 

Moon 

149.45 


331950 

0.012261 

1.41 

3.33 

27.89 

0.165 

Mercury 

57.85 

0.2408 

0.04 

3.8 

0.27 

Venus 

108.10 

0.6152 

0.81 

4.86 

0.85 

Earth 

149.45 

1.0000 

1.000 

5.52 

1.00 

Mars 

227.72 

1.8808 

0.108 

3.96 

0.38 

Ceres 

413.58 

4.6035 

0.00012 

3.3(?) 

0.037(?) 

Eros 

217.94 

1.7610 


3.3(?) 

0 . 001 (?) 

Jupiter 

777.6 

11.862 

316.94 

1.34 

2.64 

Saturn 

1425.6 

29.457 

94.9 

0.71 

1.17 

Uranus 

2868.1 

84.013 

14.66 

1.27 

0.92 

Neptune 

4494.1 

164.783 

17.16 

1.58 

1.12 

Pluto 

5937. . 

247.7 

0 . 8 (?) 




1 Russell, H. N., Dugan, R. S.,and Stewart, J. Q., Astronomy, Boston, Ginn & Co., 1920. Data 
relating to Pluto have been taken from other sources. 
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TABLE III 

An Example of the Functional Type of Table 


Same Properties of Compressed Hydrogen at 0° C 1 


V 

atm 

V 

cm 3 /mole 

d 

gm/1 

r- 

atm 

Cp 

cal/mi 

ole K° 

200 

127.1 

15.86 

227.4 

7.07 

4.91 

300 

90.12 

22.37 

365.1 

7.14 

4.94 

400 

71.62 

28.14 

521.6 

7.19 

4.98 

500 

60.56 

33.28 

699.2 

7.22 

5.00 

600 

53.19 

37.90 

900.2 

7.24 

5.04 


1 Deming, W. E., and Shupe, Lola E., Ph]/s. Rtv., 40, 850 (1932). 

2 The symbol "/" stands for fugacity. 


4. The Statistical Class of Tables. The general form of the statistical 
table and the names of its various parts are shown in the following plan: 


TABLE NUMBER 
Title 


Stub Heading 

Box Heading 

Column Heading 

Column Heading 

Stub item 

Item 

Item 

Stub item 

Item 

Item 

Stub item 

Item 

Item 

Stub item 

Item 



(a) The Title. The title of a table should describe its contents briefly. 

It should be clear, requiring no reference to the context. It should be 

complete, telling what is listed, the source of the data if not original or 

if not widely published already, and possibly the date and the scheme 

of classification. Such phrases as “A Table Showing the Relationship 

Between . . . should ordinarily be omitted. If completeness must be 

saciificed for brevity, the necessary descriptive material may be added 

as separate sentences in a headnote below the title proper or as a foot¬ 
note to the table. 
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(6) The Stub. The first column at the left, the stub, lists the separate 
categories or values of the assumed independent variable. Like all col¬ 
umns, the stub should have a descriptive heading naming the quantity 
listed and its units if expressed numerically. An exception is a stub that 
contains heterogeneous items not classifiable under a single class name. 

The choice of independent variable for tabulation is often arbitrary. 
When the stub is not quantitative the most appropriate order of enter¬ 
ing the discrete line headings depends *on the purpose of the table. The 
alphabetical order is convenient for locating a particular heading. Some 
suggestions follow. 

1. Geographical, chronological, and magnitude subdivisions are 
often listed in the stub. 

2. Stub items within any subdivision of the stub or within the stub 
as a whole should be listed in some logical classified order based on 
geographical location, time, magnitude, or other qualification. 

3. It is usually easier to accommodate a long phrase in a stub than 
in a column heading. 

4. It is usually easier to accommodate a long list of values in a 
vertical column than in a horizontal line. 

(c) The Columns. Each column should have a heading naming the 
quantity listed and, if appropriate, the units used in expressing the values 
tabulated. Abbreviations or symbols should be used only when their 
meanings are clear. 

In many tables, certain of the column headings as a group represent 
subclassifications of a more general quantity named in a box heading. 
AH such subclassifications should be both all-inclusive and mutually 
exclusive. 

(d) The Items. In the body of a table, numerical items should be 
arranged so that the decimal points are vertically aligned in each col¬ 
umn. Values expressed numerically should generally show zeros to the 
left of the decimal point in all uncertain places except that which con¬ 
tains the first uncertain digit. To the right of the decimal point a 
zero (0) as the first uncertain digit should not be omitted. Whenever 
the total for a group of individual items of one of the columns is given, 
it should preferably appear at the top of the group. Note that a zero (0) 
entry may and should have a meaning different from that of a blank 
space. A blank space should mean that information is lacking, a zero 
that the item has zero value. Sometimes a dash (—) is used to indicate 
that an item is negligible compared with the other items in the column. 
This is not desirable since it sometimes indicates lack of data. The 
question of significant figures is discussed under the functional table. 
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5. The Functional Class of Tables. In the functional table, correspond¬ 
ing values of the independent ( x) and dependent ( y ) variables are listed 
side by side. Every functional table should have a title which is clear, 
complete, and yet brief. Desired explanatory material, acknowledg¬ 
ment of source and references should follow. The form of the table is 
the same as that of the statistical table with the independent variable 
listed in the stub. Each column in the table should have a heading 
giving the name and the unit of the quantity listed. In the choice of 
the independent variable, x, the functional table is usually less arbi¬ 
trary than the statistical table. The final decision must be based on the 
nature of the data and the purpose of the table. However, the variable 
so chosen should be a simple quantity, such as time, temperature, or 
distance, rather than a complex one such as might be desirable in plot¬ 
ting the same data. If the complex quantity has some special signifi¬ 
cance its values may be listed in a separate column as one of the de¬ 
pendent variables. 

(a) Choice of the x-Interval. In constructing the table, one should 
usually (but not always) list rounded or otherwise convenient values of 
x in order of increasing (or, occasionally, decreasing) size, with succes¬ 
sive values differing by a constant amount, Ax, called the common 
difference or x-interval. Since x-values are rounded, Ax is usually 1, 2, 
or 5 multiplied by 10 ±r ‘ where n is an integer. The particular value for 
Ax in a given case usually represents a compromise between too small 
a value, which leads to an unnecessarily long table, tedious to construct, 
and too large a value, which leads to too short a table and to too fre¬ 
quent and difficult interpolations in use. For purposes of summations 
and finding rates of change, the smaller the Ax, the more accurate the 
results. A reasonable type of exception to the above indicated equal 
successive difference listing is that in which the successive ratios of 
x-values are constant. 

(b) Smoothing the Data. For a table to be of greatest service the 
^/-values corresponding to the tabulated x-values should generally be 
smoothed or graduated; i.e., the successive variations in y with succes¬ 
sive equal variations in x should be made to vary gradually. In a truly 
statistical table, this smoothing process is without significance and 
should not be attempted. 

Given an unsmoothed table of values of y = /(x), values for a 
smoothed table may be obtained (1) from an equation of y = /(x) 
which fits the data available, (2) from a graph of y = /(x) drawn to 
fit the (.lata, (3) from an arbitrary, numerical procedure, or (4) from a 
graph of item differences. I he two last-named methods involve tabu¬ 
lated values of x and y in a regularly constructed but unsmoothed table. 
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If either of the first two methods is employed, the details of procedure 
and the results will depend somewhat on the smoother’s idea as to what 
the real y = f(x) is like; and a table thus smoothed may possibly be 
inferior to the unsmoothed table. Wherever the smoothing operation 
is carried through, it should always be with the purpose in mind of 
maintaining unchanged the general trend of the unsmoothed data and 
their approximate magnitudes. 

Where the relation y = f(x) is known, no smoothing process is in¬ 
volved. One is merely concerned with listing correctly computed values. 
Likewise, where an empirical relation has been found which maintains 
the general trend of the listed items as well as their approximate magni¬ 
tudes, the procedure, which now may be classed technically as smooth¬ 
ing, is similar and obvious. Methods for finding such empirical equa¬ 
tions are given in Chapter III. 

The second-named or graphical method of smoothing consists of plot¬ 
ting the available data, or perhaps only a portion at a time, fitting a 
smooth curve, and reading the smoothed y-v allies therefrom. Plotting 
procedure is discussed elsewhere. 

Many methods characterized by arbitrary numerical procedure are 
possible. A method sometimes used is one based on a least-squares 
relation to be derived later. It assumes a constant value for Ax and a 
parabolic function for y = /(x). If carried through to a logical con¬ 
clusion, it will usually give satisfactory results. The method should 
not be used, however, unless over the range of four A.r-intervals there is 
a reasonably close approximation to a parabolic relationship of the 
assumed type. The basic equation for this method is 

a = -^5 [17yo + 12 ( 2/1 + y~\) — 3 (t /2 + V— 2 )] [1] 

where 2 /_ 2 , y- 1 , 2 /o> Vu and y 2 are five successive tabulated y-values and 
a is the smoothed value of yo which should replace yo in the smoothed 
table. Actually much time and effort may be saved in applying Eq. 1 
if a temporary shift of origin to (0,?/o) is made. In the new system, 
2 /o becomes 0. Using a', y' u etc., for the new a and y items, Eq. 1 
changes to 

a! = ^ [12(2 /'1 4- y'-i) — 3 ( 2/2 + y'- 2 )] [l fl ] 

of which the sums ( 2/1 + 2 /- 1 ) and (y' 2 + - 2 ) will normally be small 

in magnitude. The a ' obtained on this basis represents a correction to 

2 /o in the original coordinate system. 

Obviously the second-named method may on occasions be improved 
upon by smoothing also the item differences. This procedure, which is 
also applicable directly, is likely to be justified where the precision of 
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TABLE IV 

Illustrating the Smoothing of Tabulated Data by the Smoothed Item- 

Differences Method 

The data of the first two columns, obtained by Jaeger, 1 represent constant-volume 
atomic heats of platinum for various temperatures. All values for c v and Ac„ 
are in cal/(gm-atom C°). Columns headed A c' v and Ac" v represent the first 
and the second sets of approximations of smoothed values for Ac,, as obtained 
from the graph of Fig. 1. Columns headed c'„ and c" v similarly represent approxi¬ 
mations to smoothed values for c v . How well c" v is smoothed is shown by the 
column headed A 2 c"„; how well it represents the given values of c,, is shown by 
the column headed c" v — c v . (See Table V for a first approximation in the smooth¬ 
ing of the same data by another method.) 


T in °C 

c v 


Ar'„ 


c'v 

t 

c 'v 

Cv 

V 

<i 

A C v 

c"v 


— Cv 

100 

6.130 




6.130 

0.000 



6.129 

-0.001 



0.120 

0.120 





0.120 





200 

.250 

.105 

.108 

-0.012 

.250 


.000 

.108 

-0.012 

.249 

— 

-.001 

300 

.355 

.099 

.096 

- .012 

.358 

+ 

.003 

.096 

- .012 

.357 

+ 

.002 

400 

.454 

.091 

.085 

- .011 

.454 


.000 

.085 

- .011 

.453 

— 

.001 

500 

.545 

.065 

.075 

- .010 

.539 

— 

.006 

.074 

- .011 

.538 

— 

.007 

600 

700 

.610 

.068 

.066 

- .009 

.614 

+ 

.004 

.065 

- .009 

.612 

+ 

.002 

.678 

.053 

.058 

- .008 

.680 

+ 

.002 

.058 

- .007 

.677 

— 

.001 


800 

900 

.731 

.054 

.053 

- .005 

.738 

+ 

.007 

.053 

— .005 

.735 

+ 

.004 

.785 

.046 

.050 

- .003 

.791 

+ 

.006 

.050 

- .004 

.788 

+ 

.003 


1000 

1100 

.831 

.053 

.047 

- .003 

.841 

+ 

.010 

.047 

- .003 

.838 

+ 

.007 

.884 

.046 

.044 

- .003 

.888 

+ 

.004 

.044 

- .003 

.885 

+ 

.001 


1200 

.930 

.039 

.042 

- .002 

.932 

+ 

.002 

.042 

- .002 

.929 

— 

.001 

1300 

.969 

.041 

.039 

- .003 

.974 

+ 

.005 

.039 

- .003 

.971 

+ 

.002 

1100 

7.010 



- .003 

7.013 

+ 

.003 


- .003 

7.010 


.000 

1500 

.046 

.036 

.036 

- .003 

.049 

+ 

.003 

.036 

- .002 

.046 


.000 

1600 

.079 

.033 

.033 

- .002 

.082 

+ 

.003 

.034 

- .003 

.080 

+ 

.001 



.029 

.031 





.031 




1700 

.108 




.113 

+ 

.005 



.111 

+ 

.003 

1755 

.124 













1I .;, J r7V F - M ’ ° P \ lCnl Aclivitu nn ‘ l ,li » h Temperature Measurement p. 371, New York, McGraw 
Hill Book Company, 1930. 
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determination of the listed values for the dependent variable is rather 
high. The procedure is best described by showing how it operates when 
applied to a special tabulation of unsmoothed data. For this purpose, 
we use Jaeger’s 1 values for the constant-volume atomic heats of plati¬ 
num for the temperature range 100° C to 1755° C (Table IV). 

The first step in the application of the item-differences method involves 
the determining of the differences A c v . These are plotted as in Fig. 1 



Fia. 1. Increments of constant-volume atomic heats, A c v , of platinum (see Table IV) 
for 100 C° intervals as a function of temperature, for use in smoothing tabulated 
data by the successive approximation, tabular method. 

and a smooth curve is drawn to represent their means. Values of Ac'„, 
column 4 of the table, are taken from this curve and applied to some 
arbitrarily chosen recorded c v to give the first approximation c , to a 
smoothed set for c v . As shown by the columns headed A V, and 
c'„ - c V} the first attempt at smoothing has yielded results which, 
though well smoothed, are generally too high in the region 600° C < 
T < 1700° C. Revision of the values recorded for Ac',, still maintain¬ 
ing the principle that the values for Ac', need to be smoothed and 

1 Jaeger, F. M., Optical Activity ami High Temperature Measurement*, p. 371, 
New York, McGraw-Hill ft »ok Company, 1930. 
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TABLE V 

Illustrating the Smoothing of Tabulated Data by the Least-Squares 

Method as Expressed by Eq. la 

The data of the first two columns obtained by Jaeger 1 represent constant-volume 

atomic heats for platinum. The units for c„, Ac,., A’c„ y', and a' are uniformly 

the cal/fgm-atom C"). (See Table IV where the same data have been smoothed 
by means of another method.) 


T in °C 

C V 

A c v 

A 2 r t . 


) 35a' 

r V 


Ar't, 

AV t , 

100 

0.130 


















6.130 





0.120 









200 

.250 


-0.015 






0.120 




.105 






.250 


-0.014 

300 

.355 

.099 

- .000 

12( —0.000) —3( —0.035) 

4-0.033 

4-0.001 

.356 

.106 

- .007 

400 

.454 

.091 

- .008 

12( - 0.008)-3(-0.048) 

4- 

.048 

4- .ooi 

.455 

.099 

- .013 

500 

.545 

.005 

- .020 

12( - 0.020)-3(-0.057) 

— 

.141 

- .004 

.541 

.086 

- .013 

000 

.010 

.008 

+ .003 

12( + 0.003) — 3( — 0.035) 

+ 

.141 

4- .004 

.614 

.073 

- .012 

700 

.078 

.053 

- .015 

12( — 0.015) — 3( — 0.020) 

— 

.102 

- .003 

.675 

.061 

- .003 

800 

.731 

.054 

4- .001 

12(+0.001)-3(-0.023) 

+ 

.081 

4- .002 

.733 

.058 

- .008 

900 

.785 

.040 

- .008 

12( - 0.008)-3(-0.008) 

— 

.072 

- .002 

.783 

.050 

.000 

1000 

.831 

.053 

+ .007 

12(4-0.007)-3(-0.001) 

+ 

.087 

4- .002 

.833 

.050 

.000 

1100 

.884 

.040 

- .007 

12( — 0.007) — 3( —0.014) 

— 

.042 

- .001 

.883 

.050 

- .004 

1200 

.930 

.039 

- .007 

12 ( — 0.007) — 3( —0.019) 

— 

.027 

- .001 

.929 

.046 

- .005 

1300 

.909 

.041 

+ .002 

12(4-0.002) -3(-0.008) 

4- 

.048 

4- .001 

.970 

.041 

- .002 

1400 

7.010 

.030 

- .005 

12( —0.005) — 3( —C011) 

— 

.027 

- .001 

7.009 

.039 

- .002 

1500 

.040 

.033 

- .003 

12( -0.003)-3(-0.015) 


.009 

.0(H) 

.046 

.037 

- .004 

1000 

.079 

« 

.029 

- .004 





.079 

.033 

- .004 

1700 

.108 








.029 










.108 



1755 

.124 


















.124 




Jui-Ki-r, F. M., Optical Activity and High Temperature Measurements, p. 371, New York, McGraw 
Hill Book Company, 1930. 
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keeping the differences c' v — c v in mind, may be made to yield a second 
approximation which is more satisfactory than the first. Such a second 
approximation is shown in the column headed c" v . How well the 
smoothing for the differences A c v and also for c v has been done is shown 
in the column headed A 2 c" v . That the smoothed values for c v retain 
closely the general trend of the original data, an important requirement 
for any satisfactory smoothing method, is shown by the column headed 

C v Cv 

In practice, it is sometimes desirable to extend the process just de¬ 
scribed to the smoothing of second-order differences. Where the type 
of equation necessary to represent the data is not known and where the 
graph showing y = fix) is not sufficiently precise, this method would 
seem to be among the best if not the best. 

For the sake of a comparison, the smoothing of the data on constant- 
volume atomic heats of platinum listed in the first two columns of 
Table IV is carried through in Table V according to the arbitrary- 
procedure method employing Eq. la. That the smoothed values thus 
obtained will maintain the general trend of the original data is evident; 
but, as shown by the columns headed A 2 c v and AV», the smoothing 
produced by the first application is far from being as satisfactory as 
that produced by the item-differences method (see columns of Table IV 
headed A 2 c' v and A 2 c" v ). Successive application of the method employ¬ 
ing Eq. la will certainly yield successive improvements; but the rate of 
approach to a satisfactory limit will generally be slow. This, added to 
the fact that it is helpless in smoothing the two values at either end, 
makes the method seem rather unsatisfactory for practical purposes. 

(c) Significant Figures. A significant figure is any digit of a number 
which is used to help denote the size of the number rather than to locate 
the decimal point. To illustrate, consider the following length measure¬ 
ments: 

(1) 123 cm 

(2) 0.00123 km 

(3) 12.03 cm 

(4) 12.30 cm 

(5) 12,300 cm 


Measurement (1) contains three significant figures. It indicates at 
most that the quantity is nearer 123 than 122 or 124 cm; i.e., that it 
lies between 122.5 cm and 123.5 cm. Measurement (2) also contains 
three significant figures. The two zeros to the right of the decimal 
point serve only to locate the decimal point. Values (1) and (2) are 
identical. 
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Measurement (3) contains four significant figures. Measurement (4) 
also contains four significant figures. Unfortunately, the exact signifi¬ 
cance of the final zero when written as above is somewhat uncertain. 
At the most, it indicates that the quantity lies between 12.295 cm and 
12.305 cm. At the least, it indicates that the quantity lies between 
1 .275 cm and 12.325 cm. In case the latter interpretation is correct, 
the next lower and the next higher values that might be recorded on 
the same basis are 12.25 and 12.35 cm, the least count being 0 05 cm 
There is no generally accepted policy which enables the reader to tell* 
from the expression itself, precisely what was meant by the writer In 
any case, recording a measurement as 12.3 cm when it may be justly 
written 12.30 cm suggests a precision less than that actually attained 

and indicates carelessness or ignorance on the part of the re¬ 
corder. 

Measurement (5) as recorded is ambiguous, since it docs not indicate 
whether the length was measured to the nearest meter, the nearest deci¬ 
meter, or the nearest centimeter. For such quantities, when an indi- 
cat.on of precision is desired, use may be made of powers of ten, or of 
subdigits, thus, if measurement (5) had been written as 1.230 X 10‘ 
cm or as 123 00 cm, the uncertainty, except as noted in connection with 
measurement (4), would be removed. When written in the latter form, 
the small zero („) farthest to the left is understood to be the first uncer¬ 
tain digit. Accordingly, the two expressions of length have about the 
same meaning. 

For a table to be of greatest service, each value should contain neither 
more nor less than the number of significant figures it deserves. For the 

*f S ° °onn’ V ?™ CS ’ thcrcis no 1>oint in writing 300.00, 400.00, . . . rather 
than 300, 400, . since the independent x-values arc understood to 
be exact For the ^-values, however, the number of significant figures 
in each item is an indication of the reliability of the table. If the table 
is based on a theoretical equation, as are mathematical function tables, 
the possible number of significant figures is unlimited except for con¬ 
venience in construction and use. If based on an equation with experi¬ 
mentally determined constants, such as a table showing the radiancy, 
m of a black body as a function of temperature, T, where (R = aT\ 
the number of significant figures depends on the precision of the experi¬ 
mental constants, ,n this case <, This principle also holds for an un¬ 
known law, as in a table showing the brightness of a black body as a 
function of temperature. 

There is no generally accepted rule for deciding the exact number of 
digits to lecoul Mien tabulating a set of values of known precision. 
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The American Society for Testing Materials gives rules 1 which gen¬ 
erally result in a number containing two doubtful digits. They state, 
however, that for some purposes it is satisfactory to drop all digits 
uncertain by more than about 15 units. A value recorded as 34.7, then, 
may lie at best between 34.55 and 34.85, or at worst between 33.2 and 
36.2. If the first set of limits is known to have too great a separation, 
another significant figure is permissible; or if the second set is still too 
small, the number should be rounded to 35. This is the practice which 
the authors are inclined to favor. Still another practice consists of 
retaining the last figure uncertain by less than 10 units. Then 34.7 
would mean a value between 34.6 and 34.8 at best or between 33.7 and 
35.7 at worst. Sometimes the uncertain digits are printed inferior, e.g., 
34.7. A discussion of what is meant by the precision of a value may 
be found in Chapter VII. 

( d) Rounding Off Numbers. If a number is to bo rounded to a specific 
number of significant figures the following rules 2 should be observed: 

1. If the first digit to be dropped is less than five, the last digit 
retained is left unchanged. 

2. If the first digit to be dropped is greater than five, or is five 
followed by digits greater than zero, the last digit retained is increased 
by one. 

3. If the digit to be dropped is five followed by zeros only, the number 
is rounded to its nearest even value. 

Thus, rounding to one decimal place, 

12.345 yields 12.3 
12.367 yields 12.4 
12.356 yields 12.4 
12.350 yields 12.4 
12.450 yields 12.4 

(e) Abbreviated Forms of Tabulation. Within the limits of space which 
may be accorded them, tables should be so constructed that a desired 
quantity may be obtained with the greatest ease. Doing so necessitates 
not only the observance of the general policies set forth above but also 
certain procedures for certain special cases about to be presented. For 

1 1933 A.S.T.M. Manual on Presentation of Data, p. 44, Second Printing, March 
1937, A.S.T.M., Philadelphia. 

2 These rules are slightly different from those recommended by the A.S.T.M. 
Manual on Presentation of Data , p. 44. 
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the most part, these procedures concern abbreviated forms of ex P^ es " 
sion and, in addition to making it easier for the user of a table to find 
desired material, save in space and in printer’s ink. Five such specia 

cases will be considered. 

1 Given that all values for a variable are fractional and that, when 
written decimally, they have digits other than zero in the first or 
second place to the right of the decimal point, the customary policy 
is to list a zero in the units place for the first value of a column of 
values but not in the succeeding values of that column. See Tables 
I and II of Appendix 2. Often even the zero for the initial value is 

not listed. . 

2. Given, as a variation of the first case, that the first significant 

digit, particularly if occupying the first place to the left of the decimal 
point, varies only occasionally, a common practice consists in re¬ 
cording that significant digit for the value at the top of the column, 
leaving the corresponding position vacant for all following values until 
a change in that digit occurs, recording the new digit and proceeding 
as before. Table IV of this chapter contains two such illustrations. 

3. For cases where the values for a variable are expressed in terms 
of 10 4_n or 10 -n of what is considered a satisfactory unit, two pro¬ 
cedures are rather common, (a) According to one procedure a column 
heading is often written in an appropriate corresponding form. See 
Table II of Chapter VII. ( b ) According to the other procedure, the 
first value in a column is sometimes written as, say, 0.0 5 010 provided 
that all values for the column agree in having zero in each of the first 
five places to the right of the decimal point. Other values, properly 
aligned, then include only three digits each to correspond to the 010 

of the first value. 

4. Given that all values to be listed in a column are given with 
several significant figures of which only a few vary throughout the 
column, two procedures are common, (a) According to one procedure, 
that which is listed is the difference between actual values for the 
variable and some rounded convenient value. See Table III of Chap¬ 
ter VII, where only those portions of velocities in excess of 299,000 
km/sec are recorded. (6) According to the second procedure, a com¬ 
plete value is recorded for the first of the column only. Succeeding 
values will include digits only in places where variations occur in the 
column. Thus, as such succeeding values for the first column of the 
table just referred to, we might have 299,728, 733, 738, . . . , 818, 
and 823. Of course, the final digits for all values must fall in the 

same vertical line. 
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5. The last case to be named concerns quantities that usually have 
the same number of significant digits but which vary considerably in 
order of magnitude. A common custom here makes use of powers of 
ten. The details of application will naturally vary with the author. 
In Tables VII and VIII of Appendix 2, the power of 10 is indicated 
by the number enclosed in parentheses. Thus from Table VIII, we 
see that k 2 for n = 6 is 14,285,714 X 10 -9 and that k 2 for n = 40 
is 46,904,315 X 10~ 12 . 


(/) Tabular Differences. The successive tabular differences of the 
^/-variable are of importance in certain interpolation methods and in 
testing the type of relationship between y and x. The first difference, 
denoted by the symbol A, is defined by the equation 

A y n = 2/n+i - Vn [2] 


Higher order differences, A 2 , A 3 , etc., are similarly defined: 


A 2 y n — At/n+i A y n — y n +2 ^yn-\-\ T 2/n [3] 

A *y n = A 2 ?/ n+ i - A 2 y n = y n + s - 3 y n+2 + 3y„+i - y n [4] 


Such successive differences are often arranged as in Table VI. 

TABLE VI 


Illustrating the Usual Form of the Difference Table 


X 

y 

&y 

A 2 y 

A *y 

A V 

*0 

Vo 

A^o 




Zq + Ax 

yi 

A»/i 

A 2 ?/o 

A V 


xo + 2 Ax 

Vi 

Aj/2 

A 2 yi 

A 3 yi 

A 4 j/o 

xo 4* 3 Ax 

Vz 

Ayz 

A 2 */2 



xq + 4 Ax 

• 

V* 





• 

• 
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A numerical example is given in Table VII. 

TABLE VII 

Illustrating the Method of Constructing a Difference Table 

[Note that since x- and i/-values are related by the equation y = 1 + 3x + 3x 2 , all differences of the 

third and higher orders vanish.] 


X 

y 

Ay 

A 2 y 

A 3 y 

A 4 !/ 

-2 

7 

-6 




-1 

1 

0 

6 

0 


0 

1 

6 

6 

0 

0 

1 

7 

12 

6 



2 

19 






6. Interpolation. There are numerous interpolation procedures for 
finding intermediate ^/-values corresponding to a given z-value in the 
range of a particular table. The appropriate procedure depends on the 
accuracy of the table, the typo of relationship presented, and the pre¬ 
cision desired. One or another of the simpler methods given below will 
ordinarily serve for most purposes. Other methods may be found in 
more advanced texts. 1 

(a) The Graph Method. Finding by interpolation a y corresponding 
to a given x , x n say, necessitates four steps: (1) selecting from the table 
certain convenient corresponding values of x and y in the region of x n} 
(2) plotting these values on ordinary cross-section paper, (3) drawing 
the best curve to express y = f(x), and (4) reading the desired y n from 
the curve. Depending on the number of points plotted, the openness 
of the scales selected, and the care used in plotting and drawing the 
curve, this method may be used to give poor, moderate, or highly accu¬ 
rate interpolations. Unless the table is very detailed, a worker requir¬ 
ing frequent interpolations from a given table will ordinarily make such 
a graph and use it thereafter to the practical exclusion of the table. 
The principles of plotting data are treated in the following chapter. 

(b) The Proportional Part Method. When interpolations are to be 
made from a given table only occasionally, or when graphing is not 

1 Whittaker, E. I., and Robinson, G., The Calculus of Observations , Chap. I» 
London, Blackie & Son, Ltd., 1924. 
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practicable, numerical methods can be used. Of these, the proportional 
part method is the simplest. It assumes that between tabulated values 
of x y y varies linearly with x. Using this method, the ?/-value corre¬ 
sponding to a given x lying between two successive tabulated points, 
(xi f yi) and (x 2) y 2 ) is obtained from 


y = y i + 


2/2 - y i 

X 2 — Xi 


(x - Xi) 



(c) The Gregory-Newton Method. This method is longer but more 
accurate than the proportional part method. It is based on the assumed 
relation 



= A + Bx + Cx 2 + Dx 3 + • • • 



containing unknown constants A , B , C, etc. It is derived as follows. 
Referring to Table VI, it is seen that 


2/i = Vo + &yo 

2/2 = 2 /i + Az/i = i/o + 2A?/ 0 + A 2 y 0 

2/3 = 2/2 + A 7/2 = 2/0 3Ai/q -f~ 3A”7/o + A'h/o 


In general, it is evident that for integral values of n , 

, a , n ( n - 1) a2 , n ( n ~ i)( n “ 2) 

2/n = 2/o + rcAi/o H- At/oH -A^t/q + * * * [7] 

where n = (x — x 0 )/Az, and in which the coefficients of the A’s are 
those of the binomial theorem. Provided Eq. 6 is fulfilled, it may be 
shown that Eq. 7 holds for all positive values of n, fractional as well 
as integral. It gives directly the y corresponding to any given x in 
terms of a neighboring tabulated basic value, y 0 (usually the nearest 
smaller value), and the successive differences, A y 0 , A 2 y 0 , etc. The re¬ 
striction of Eq. 7 to positive values of n does not prevent its use for values 
of x less than Xo. It is then necessary to consider the table in order of 
decreasing values of x, whereupon Ax is negative. However, n remains 
positive. 

In general, Eq. 7 is an infinite series. Usually, however, and espe¬ 
cially when Ax is small, the terms of the higher orders are negligible in 
comparison with the first few terms, so that the formula is ordinarily 
practicable. The exact number of terms to be used depends on the par¬ 
ticular case at hand. Note that if the terms beyond that containing 
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Ai/o are disregarded, we have the formula for the proportional part 
method. 

Illustrating the use of Eq. 7, let us determine the value of the proba¬ 
bility integral, 

Ph* = A= f e"*’** d{hx) [7a] 

V 7T Jo 

corresponding to hx = 0.97, by interpolation, using data given in the 
first two columns of Table VIII. Using 1.00 as the basic Ax-value, the 

TABLE VIII 


Data and Computations for Determining a Probability by the Gregory- 

Newton Interpolation Method 


hx 

Phz 

A P hx 


A *P hz 

1.00 

0.84270 

-0.04579 



0.90 

0.79691 

-0.05481 

-0.00902 

-0.00047 

0.80 

0.74210 

-0.06431 

-0.00949 

-0.00015 

• 0.70 

0.67780 

-0.07394 

-0.00964 


0.60 

0.60386 





rr 0 of the preceding discussion, and —0.10 as A hx, n becomes 0.3 and we 
obtain for P 0 . 97 or, from the standpoint of Eq. 7, for 2 / 0 . 3 , 


P 0.97 = 0.84270 + 0.3( — 0.04579) + ^ (-0.00902) + • • • 

md 

= 0.84270 - 0.01374 -f 0.00095 - 0.00003 H- [8] 

= 0.82988 

The value obtained, 0.82988, is greater by 0.00001 than that generally 
reported. It is much more precise than the value obtained by the pro¬ 
portional part method, namely, 0.82896, which is given by the first two 
terms of the right-hand member of Eq. 8. 

(' d) The Equation Method. This method consists in finding an em¬ 
pirical equation, y = f(x), to fit certain selected tabulated values of x 
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and y , substituting therein the given value for x, and solving for the 
desired y . The particular type of equation to select will depend on the 
nature of the table. Ordinarily, the power series, 

y = A + Bx + Cx 2 H- [9] 

suffices. For sufficiently small ranges, only three terms are necessary. 
Constants A, B, and C may be determined to yield an equation that 
will pass through any three selected points, (x x ,yi), (x 2 ,y 2 ) f and (x3,2/3). 
As such points, the three nearest the given x are usually chosen. In 
determinant form, the desired equation is 


2/ 

1 

X 

x 2 

yi 

1 

Xi 

Xi 

2/2 

1 

x 2 

x 2 

2/3 

1 

Z3 

*3 




Eq. 10 may be reduced to the form of Eq. 9 if values for A, B, and C 
are desired. If not so desired, we may substitute an appropriate value 
for x directly in Eq. 10 and solve the determinant for the desired y. 

Where the intervals x 2 — x Y and x 3 — x 2 have the same value Ax, 
much time may be saved by changing the origin of coordinates as from 
(0,0) to ( x 2 ,y 2 ). Representing the new coordinates by x' and y' where 



II 

H 

[ii] 

and 

c* 

5* 

I 

II 

[12] 

we have 

II 

►— 

> I 

H 1 

H 

tc 

II 

te 

II 

1 

[13] 


X2 ~ X2 -0 

Ax 

[14] 


x’z X3 ~ X2 -l 

Ax 

[15] 


V'i = 2/i ~ 2 / 2 , etc. 

[16] 
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In the new coordinate system Eq. 10 becomes 


y’ 1 x' x' 2 

y\ 1 -1 1 

0 1 0 0 

y*3 i li 


which reduces at once to 

y' 
y\ 
y’ 3 





Eq. 18 may be quickly solved for y', and y may then be obtained by 
adding y 2 . 

To illustrate the use of Eq. 18, consider the problem of the previous 
section. Representing hx by x and P by y } the necessary tabulated data 
in terms of the original and the shifted coordinate systems become 


X 

y 

(hx) 

(P) 

0.80 

0.74210 

0.90 

0.79091 

1.00 

0.84270 


x’ 

y 

-1 

-0.05481 

0 

.. 0 

1 

0.04579 


For x = 0.97, x' = 0.7. Substitution in Eq. 18 yields 


y ' 0.7 0.49 

-0.05481 -1 1 

0.04579 1 1 




from which y' = 0.03300, and y = 0.82991. This value is greater than 
that usually reported by 0.00004. 

Although it has been assumed in the foregoing that there is a common 
a;-interval, such is not necessary. The procedure for this infrequent 
case is left to the reader. 

Eqs. 18 and 19 give the same interpolation as the Gregory-Ncwton 
formula, with the terms beyond that containing the second difference 
omitted. 

(e) The Lagrange Method. This method is of particular importance 
because it can be used to find the y-value corresponding to a given 
.r-value when, instead of a formal table, we have simply a group of corre¬ 
sponding x- and y-values not separated by the common difference, A.r. 


J & K University 4 t±rarw 

Acc. No. 3 3 9 
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The Lagrange interpolation formula assumes that y may be expressed 
as a finite power series in x, as in Eq. 9, namely 

y = A + Bx + Cx 2 -|-. [9] 

If the determinant of Eq. 10 or a similar one, containing more terms if 
desired, is expanded to express y in terms of y u y 2 , y 3 • • • and the de¬ 
terminant minors Y , Fj, Y 2 , Y 3 • • •, one obtains directly 



Expansion of the minors leads to the standard Lagrangian form of 
equation, namely 


' (x - 

v = Vl l(^ 


- x 2 ) (■ X - X 3 ) (x - X 4 ) (■ X - x 5 ) 

- X 2 ) - X 3 ) (Xi - X 4 ) (Xi - X 5 ) 


[20a] 


. r (x — Xi) (x — .r 3 ) ( x — x 4 ) (x — :r 5 ) 

+ V 2 7-r X t -r X t -r X 7-7 X 

l(x 2 - Xj) (x 2 - x 3 ) (x 2 - x 4 ) (x 2 - x 6 ) 


There are as many terms as there are points used in the interpolation. 

To illustrate, suppose it is desired to find the current which will heat 
to 2500° K, in vacuo, a long tungsten filament whose radius is 0.0G2 mm. 
From a list of tabulated values, we find, for instance, that the currents 
for wires with radii of 0.030 mm, 0.050 mm, 0.080 mm, and 0.100 mm 
are 0.690 amp, 1.485 amp, 3.000 amp, and 4.200 amp, respectively. It 
follows, from the Lagrange formula, in case, for convenience, we use the 
micron values for the filament radii, that 



0.090 amp 




62 - 50 
30 - 50 


62 - 80 62 - 100" 
30 - 80 30 - 100. 


-f- 1.485 amp 



62 - 80 
50 - 80 


62 - 100 
50 - 100. 


+ 3.000 amp 

T 62 - 30 62 - 50 62 - 80 

+ 4.200 am P.[ 100 _ 30 1()0 _ 5Q 10Q _ g0 J [ 21 ] 

= (-0.0809 + 1.0835 -f 1.4592 - 0.4147) amp 
= 2.047 amp 


62 - 30 62 - 50 6 2 - 100 
80 - 30 80 - 50 80 — 100 


i 
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This is very close to the 2.048 amp predicted by the % power law for 
the condition of constant temperature, namely, 



It is interesting to note that, with the separate omissions of terms in¬ 
volving the 0.030 mm and 0.100 mm wires, the values obtained for 



Fig. 2. Graph showing possible clangers in assuming without testing that a simple 
power series expressing y in terms of x holds when the values for Ax vary consider¬ 
ably. The increments of curves A and B between points of crossing are much more 
nearly equal than those for curves A and C. Between the limiting points of cross¬ 
ing, the former pair gives more nearly the same loci of points than the latter pair. 


/o.o 62 are respectively 2.045 amp and 2.051 amp; and that, when the 
terms involving these two wires are omitted simultaneously, the pro¬ 
portional part value of 2.091 amp is obtained, as is to be expected. 
Any number of corresponding / and r values may be substituted in 


Eq. 20. As might be expected, the terms involving the wires nearest 
the given wire in size are the most important in determining the desired 


current. 


Although intended principally for use where the ^-intervals are non- 
uniform, the Lagrange method applies equally well to interpolations 
from a formal table with a constant Ax. 
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In the application of methods based on the empirical power series 
forms of Eqs. 6 and 9, one needs to consider certain possibilities for 
trouble, particularly where the Az-intervals differ considerably. To il¬ 
lustrate, the points (0,0), (4,2), and (16,20) not only satisfy the equation 


but also the equation 


X X 

y - 4 + 16 

[23] 

_ 32 y y 2 

X 15 15 

[24] 


How great is the danger in interpolating in these two cases is shown in 
Fig. 2, where both equations are graphed. If, however, the values for 
Ax and for Ay are separately of the same order, there is not the same 
great danger in the selection of the wrong power series. Thus for the 
points (0,0), (8,6), and (12,12), we have the two equations 


and 





[23] 

[25] 


As shown also in Fig. 2, the plot of Eq. 25 will generally yield interpo¬ 
lated values for y which are not so greatly different from those obtained 
using Eq. 23. 

(/) The Taylor's Series Method. The usefulness of this method is lim¬ 
ited to tables based on a known transcendental equation. For such 
tables the method gives good results. In accord with Taylor’s series, 
the interpolation formula is 

y = f(x) = f(x o + Sx ) 

= /Oo) + /'(Xo) ~ + j"{x o) + f"(x o) (6 3 f- +■■■ [26] 

where Sx = x — x 0 and the primes indicate differentiation with respect 
to x. 

It suffices (1) to select from the table an x 0 as near as possible to the 
given x, (2) to form f'(x 0 ), /"0e o ), etc., an d (3) to insert those values, 
together with the appropriate Sx into the formula to obtain the desired y. 

Suppose it is desired to find the value of e~ 8 2 . In a table, we find 
for e -8 0 and e -9,0 the values 335 X 10 -6 and 123 X 10 -6 . Applying 
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the Taylor’s series method, we have in turn 


f(x) = e 


—X 


f'(x) - -e 


—X 


f"(x) = e~ x , etc. 

8x = 8.2 - 8.0 = 0.2 


whence 


y 


= e " 8 - 2 = e " 8 0 - e “ 8 0 ( 0 . 2 ) + e ~ 80 


0.04 


[27] 


= c” 8 - 0 (1 - 0.2 + 0.02 - 0.0013 4- 0.00007 • • •) 

= 335 X 10- G (0.8188) = 274 X 10“ 6 

The value obtained is as precise as the value given for e -8 0 . 

7. Extrapolation. When the value of y is desired for an x outside the 
range of values covered by the data, we must resort to extrapolation. 
In method, extrapolation and interpolation are alike; any of the inter¬ 
polation procedures described above may be used for extrapolating. The 
chief differences lie in the accuracy of our results. 

Where the law stating the dependency of y upon x is known, no 
difficulty is experienced in either interpolation or extrapolation. All 
methods, except the simple proportional part method, may be used 
with equal safety even if not with equal ease if the range of extrapola¬ 
tion is not too great. However, the equation and the Taylor series 
methods are then particularly applicable. Generally such determina¬ 
tions are not regarded as extrapolations. Where nothing of the law of 
variation is known, beyond the range for which tabular values are given, 
extrapolations represent little more than guesses which have a certain 
amount of reasonableness. Where something of the law of variation is 
known, extrapolations take on increased probabilities as to correctness. 
As a result certain extrapolations can be made with a degree of certainty 
which is rather high. To illustrate, the brightness of carbon at tempera¬ 
tures above its normal sublimation point, such as are realizable under 
pressure, has not been determined experimentally nor is its law of varia¬ 
tion known. Knowing, however, that the radiations from carbon are 
subject to certain laws of thermodynamics permits one to set certain 
upper and lower limits within which extrapolated brightnesses for the 
carbon must fall. 

8 . Summary. The table, one of three forms for presenting data, lists 
corresponding values or properties of the dependent and independent 
variables in an orderly arrangement. Tables are simple and inexpensive 
to construct, easy to use, and compact. 
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There are three classes of tables: the qualitative, the statistical, and 
the quantitative or functional. The principal parts of the statistical 
table are the title, the stub, column headings, and items. 

The functional table is similar to the statistical in form, but lists 
corresponding values of dependent, y y and independent, x, variables. 
Values of x differ commonly, but not always, by a constant amount. 
Preferably ^/-values should be smoothed. Depending on circumstances, 
this may be done (1) by taking corresponding values from an equation 
that represents the data, (2) by taking corresponding values from a 
graph in which a smooth curve has been drawn to represent the data, 
(3) by applying corrections obtained by an arbitrary mathematical pro¬ 
cedure such as is connected with Eq. la, or (4) b}' smoothing the item 
differences, applying such differences to obtain an approximate smoothed 
tabulation and finally adjusting to obtain a tabulation which maintains 
also the general trend of the unsmoothed tabulation (Table IV and 
Fig. 1). Except where the law of variation in equation form is known, 
the last-named procedure is obviously best. 

The precision of tabulated data should be indicated by the number 
of significant figures in the items. Generally the last digit of an item 
should be the first deemed uncertain digit unless the uncertainty is of 
the order of 1^ or less, in which case a second uncertain digit—either 
a zero or five, whichever seems closer to the true value—is permissible. 
Some prefer not to round off these last digits. 

In rounding off numbers, the last digit retained is left unchanged or 
increased by one as the amount dropped is less than or in excess of 0.5 
of a unit in the last place retained. If the amount dropped is just 0.5 
of a unit, the last digit retained is made an even digit by leaving it 
unchanged or by increasing it by one if necessary. 

In using a table, interpolation is often resorted to for finding the y 
corresponding to a given x for intermediate values of x. Interpolation 
may be done graphically by fitting a smooth curve to the tabulated data 
and reading y from the curve. A second method is the proportional 
part method, where 

y = 2/1 + v ~ ~ y ‘ (* - Xi ) [5] 

X2 ~ X Y 

and (x u yi) and (x 2 ,y 2 ) are successive tabulated points such that 
Xi < x < x 2 . The Gregory-Newton interpolation formula is 

, . , n(n — 1) 0 

V = Vo + nAy 0 H-—-A 2 y 0 H- [7] 

where ( x 0 ,y 0 ) is the tabulated point nearest (x f y) and n = (x — x 0 )/Ax. 
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The equation method consists in selecting three tabulated points (x i} y i), 
(* 2 , 2 / 2 )» and (* 3 , 2 / 3 ) nearest ( x,y ), shifting the origin and changing co¬ 
ordinates by means of the substitutions 


[ 11 ] 
[ 12 ] 

substituting values of y\> y' 3 , and x' in the determinant equation 




y'i 
y' 3 



1 

1 



[18] 


and solving for y ' and then y. The Lagrange formula, Eq. 20, is useful 
for interpolating from a list of values not arranged in a formal table. 
The Taylor’s series method, Eq. 23, gives good results for tables based 
on a known transcendental equation. 

Tables may be extrapolated by applying interpolation procedure to 
values of x outside the range of the tabulated x-values. Except where 
the law relating y and x is known, such extrapolations are only approxi¬ 
mate at best. Extrapolations for values of * just beyond the limit of a 
table are safer than those for values considerably beyond the limit. 


PROBLEMS 

1. The following table is a portion of a table representing the results of an extended, 
important .study of air by Roebuck. 1 It shows the Joule-Thomson effect fi of air 
expressed in C°/atm as a function of temperature T and pressure p. 


\ T in 







\ °C 

0 

50 

100 

150 

200 

250 

P in 







atm \ 







1 

0.2746 

0.1956 

0.1355 

0.0961 

0.0645 

0.0409 


.2577 

. 1S30 

.1258 

.0883 

.0580 

.0356 

60 

. 2200 

.1571 

.1062 

.0732 

.0453 

.0254 

100 

.1822 

.1310 

.0884 

. 0600 

.0343 

.0165 

140 

.1446 

. 1070 

.0726 

.0482 

.0250 

.0092 

180 

.1097 

.0829 

.0580 

.0376 

.0174 

+ .0027 

220 

.0795 

. 0609 

.0449 

.0291 

.0116 

- .0025 


1 Roebuck, J. R. t Proc. Am. Acad. /Irk* Set., 60, 537 (1925), as corrected by the original author. 
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This table may be improved by smoothing both as to pressure and as to temperature. 
Smooth as to variations in pressure. When so smoothed, note whether there seems 
to be need for further smoothing as to temperature. 

2. The fractional voltages and candle powers of vacuum tungsten lamps in terms 
of their normal voltages and candle powers at 2450° K as a function of temperature 
has been reported 1 as follows: 


T in °K 

k in % 

j m % 
* n 

2000 

55.0 

10.4 

2100 

63.6 

18.6 

2200 

73.3 

32.2 

2300 

83.5 

52.2 

2400 

94.3 

81.4 

2450 

100.0 

100.0 

2500 

105.9 

122.0 

2600 

118.5 

179.3 

2700 

132.3 

257.0 


Form a new table with smoothed values, maintaining the values as 100.0% for 
2450° K. Note that end values are as liable to err as are other values. For smooth¬ 
ing the I/I n values, consider a curve showing A log ///„ as a function of T. 

3. Derive Lagrange’s interpolation equation. 

4. For the molal heat of air at a pressure of 20A, Roebuck 2 gives the following 
values as a function of temperature. 


T 

Cp 

T 

Cp 

-100°C 

0.2757 cal/(mole K°) 

+ 75° C 

0.2475 cal/(mole K°) 

- 75 

.2630 

100 

.2470 

- 50 

.2556 

150 

.2466 

- 25 

.2514 

200 

.2463 

0 

.2492 

250 

.2468 

4* 25 

.2487 

280 

.2471 

+ 50 

.2480 




Determine the values of c p for air at 20A and +40° C, —20° C, and —60° C. 

6. The spectral transmittances of a 6 mm thick, 28%, Corning high-transmission 
red glass as reported in a graph by Forsythe are: 

X 0.03 M 0.64 0.65 0.66 0.67 0.68 0.69 0.70 0.71 0.72 0.73 0.74 

t 0.00 0.02 0.25 0.60 0.735 0.770 0.770 0.765 0.760 0.750 0.745 0.735 


Determine the transmittances at 0.655 n and 0.665 n. 

1 Forsythe, W. E., and Worthing, A. G., Astrophj/s. J 61, 152 (1925). Values for 2400 c lv adjusted 

2 Roebuck, J. R., Proc. Am. Acad. Art* Sci., 64, 287 (1930). 
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6. For the variation in relative spectral brightness at 0.534 /x from center to limb 
of the sun’s disk, Abbot 1 of the Smithsonian Institution gives the following data: 


r i 


- 0.00 
a 

0.40 

0.55 

0.65 

0.75 

0.825 

0.875 

0.92 

0.95 

B\ 

R 463 

440 

417 

396 

366 

337 

312 

281 

254 


Determine, by the proportional part, the graph, and the Lagrange methods, the 
relative spectral brightnesses at r/a = 0.20 and r/a = 0.80. When graphing, choose 
the scales so that the line drawn makes an angle of roughly 45° with the coordinate 
axes. 

7. Using the data of Problem 6, extrapolate to determine a relative spectral 
brightness for 0.534 y at r/a = 0.98, using a combined graph and Gregory-New ton 
method and the Lagrange method. 

8. Smooth the following tabulation of spark-potentials between 75-cm (diameters) 
spheres in air with the positive sphere grounded as a function of sphere separation. 


Gap 

Sparking 

Potential 

Gap 

Sparking 

Potential 

5 cm 

137 kv 

35 cm 

720 kv 

10 

263 

40 

775 

15 

382 

45 

825 

20 

483 

50 

870 

25 

573 

55 

908 

30 

650 

60 

937 


Ilandhuch der Physik (Geiger and Scheel), 16, 407 (1927), via Hoag’s Electron and 
Nuclear Physics, 401 (1938).) 

9. Koch has reported the following values for y the ratio of the two specific heats 
of air at 0° O and various pressures. All values are based on Roentgen’s 1873 de¬ 
termination of 1.4053 for 1A and 0° C. Smooth the tabulated values. 


Pressure 

7 


Pressure 

7 

1 A 

1.4053 


125 A 

1.690 

25 

1.473 



150 

1.739 

50 

1.530 



175 

1.783 

75 

1.593 



200 

1.828 

100 

1.646 





10. The following table 

of heats 

of vaporization of water for 

various temperatures 

ikon from a well-known source sli 

lOWS 

need of smoothing. Form a smoothed table. 

T L 


r 

L 

T 

L 

°C cal gm 


°C 

cal gm 

°C 

cal/gm 

0 595.4 


70 

556.9 

140 

511.5 

10 590.2 


80 

551.1 

150 

504.1 

20 584.9 


90 

544.9 

160 

496.5 

30 579. 6 


100 

538.7 

170 

488.7 

40 574.2 


110 

532.3 

180 

480.6 

50 568.4 


120 

525.6 

190 

472.3 

60 562.8 


130 

518.6 

200 

463.8 

1 Abbot, C. G., The Sun as 

a Source t 

of Continuous Radiation, p. 7G of 

Measurement of Radiant 

nergij, Ed. by W. E. Forsythe 

'» New \ork, McGraw-Hill Book Company, ] 

L‘J37. 
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REPRESENTATION OF DATA BY GRAPHS 

!• Introduction. The graphical method of presenting data is an 
adaptation of the principles of Descartes’ analytic geometry, whereby 
numerical values are represented in geometrical form by the length of 
a line, the area of a surface, the volume of a solid, or the rotation de¬ 
scribed by an angle. The fact that all measurable quantities may be 
given such representation does not mean that all data should be plotted. 
For certain data a graph means little more than wasted time and labor. 
For other data, failure to graph results not only in a loss of time and 
energy, but also in a failure to perceive significant relations. A decision 
as to whether or not to plot must be trusted to one’s common sense. 

In this chapter we set forth the general advantages and purposes of 
graphical representation. Examples and illustrations are given, first of 
the simple qualitative type, then of the more important quantitative 
type. Finally, specific suggestions and rules are stated for the con¬ 
struction of graphs of the latter type. 

2. Advantages of Graphs. In favor of graphs generally, it may be 
said that (a) they facilitate comparisons of values, (6) they appeal to 
the attention of a reader, ( c) they permit easy reference to data, and ( d) 
they provide a compact form for filing. In addition, most graphs will 
reveal readily the presence of maxima, minima, critical inflection points, 
unusually high or low rates of change, and periodic or other significant 
features in a set of data, whereas otherwise certain of these features 
may be either overlooked entirely or seen only after a rather careful 
survey of the tabulated data. Further, with the aid of a graph, one can 
often determine whether or not a relationship exists between the two 
variables being considered, and sometimes, if a relationship exists, its 
mathematical form. Still further, if a satisfactory curve can be drawn, 
one may differentiate or integrate one variable with respect to the other 
directly from the graph without knowledge of the mathematical form 
of the relation represented. These advantages warrant a somewhat de¬ 
tailed study of graphs. 

3. Purposes of Graphs—Qualitative and Quantitative. A graph may 
generally be classed as belonging to one or the other of two groups, 
depending on the main purpose it is to serve. Those of the first group 
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are designed primarily to present a qualitative picture of a process (e.g., 
the growth of population in the United States) or of a condition (e.g., 
the sizes of the available armies of the European nations in 1939). 
Graphs of the second group are intended primarily as quantitative tools 
in operating and controlling mechanisms and methods or as guides in 
research. Commonly both purposes are served by a single graph, though 

usually one or the other predominates. 

4. The Qualitative Graph. Of the qualitative graphs, we have those 

in which there is represented: (a) one variable, y, as though a function, 




Fig. 1. Examples of two types of qualitative graphs showing their characteristic 

differences. (Data from 16th Census of the U.S., 1940, Series P-3, No. 21, Nov. 15, 

1941.) 

f(x), of the other variable, but actually without any suspected causal 
connection other than that of a simultaneity in time, coincidence in 
location, etc., and (6) y = f(x) with a known or suspected causal con¬ 
nection between the variables. The graphs of Fig. 1 illustrate some of 
the differences between the two groups. Graphs (A) and (B) are both 
plots of the same data. In (A) the relative populations at the ends of 
succeeding decades are emphasized. In ( B ) it is assumed that popula¬ 
tion and time are somehow related and emphasis is placed on this i ela¬ 
tion. Both (A) and (B) belong to the qualitative class of graphs, for 
though (B) is of the type most commonly used as a tool, it is not in¬ 
tended nor is it, in many respects, able to serve any of the uses men¬ 
tioned in the following section. It is seen (1) that (A) is a more striking 
presentation than (£), though the latter shows the rate of growth more 
clearly; (2) that plotted values of population can be read more quickly 
from (A); and (3) that ( B) permits more accurate interpolations and 
extrapolations, uses commonly associated with the quantitative graph. 
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(A). A stepped line graph showing average rainfalls in Pittsburgh for the different 
months of the year for the interval 1880 to 1930. (Report of the U. S. Weather 

Bureau.) 


i 



Atomic Number 

( B ). A broken line graph showing the atomic volumes of the elements as a function 
of their atomic numbers. ( Untv. of Pittsburgh, Atomic Physics, 2nd Ed., p. 190, 
New York, John Wiley & Sons, 1937.) 

Fia. 2. Four types of qualitative line graphs. 
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(C). A smooth line graph showing losses of mass sustained in the synthesizing of the 
different types of atoms from the simpler atoms. ( Univ. of Pittsburgh, Atomic 
Physics, 2nd Ed., p. 45, New York, John Wiley & Sons, 1937.) 


Ends of 20 year intervals 

1860 1880 1900 1920 1938 



(D). A variation-from-the-mean line graph showing deviations with time at four 
American cities of the average autumn temperatures (strictly 20 year moving 
averages) from the mean autumn temperature for the 100 year interval 183.7 to 
1939. ( Kincer , J. B., Temperature Distribution , Extremes, and Trend Tendencies 

Over the Earth's Surface, from the symposium entitled Temperature, Its Measure¬ 
ment and Control in Science and Industry, p. 355, New York, Reinhold Publishing 
Corp., 1941.) 

Fig. 2. Four types of qualitative line graphs.— Continued. 
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Tungsten 

Steel 

Nickel 

Tantalum 

Copper 

Platinum 

Aluminum 

Tin 


Tensile Strength in Ibs./in? 


0 200,000 400,000 600,000 





(A). The approximate maximum tensile strengths of wires of various metals. ( Hand¬ 
book of Chemistry and Physics , 26th Ed., p. 1629, Cleveland, Chemical Rubber 
Publishing Co., 1942.) 


Cause of Death 0 


Accidents 


Appendicitis 


Diseases of 
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Death Rate per 100,000 Population 
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Diseases 


Pneumonia 
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Influenza 

Measles, 

Whooping Cough, 
Scarlet Fever 
& Diptheria 

Tuberculosis 


Leading Causes of Death 
at Eleven, the Age of 
Lowest Mortality 
Source: Statistical Bulletin, — 
Metropolitan Life Insurance Co. 
Nov. 1936, Page 2 



Boys 


Girls 


40 



( B ). The leading causes of death at the age of eleven, the age of lowest mortality 
(Metropolitan Life Insurance Co. Statistical Bulletin, Nov. 1936.) 

Fia. 3. Four types of qualitative bar charts. 
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1787 1930 

OOOOOOOOOO Electricity _ COOOOOOOOO 
OOOOOOOOOO _Engines_ 3000000000 

Work Animals 

& Water Power ^03«#000000 

OOOOOOOOOO Tracto.s oooo»»«ooo 
OOOOOOOOOO Trucks ooooooo««» 


Each Disc Represents 10 % of the Total Power 

(C). Types of power other than human labor power available on U. S. farms in 1930 
compared with 1787—a multiple unit bar chart. ( Cohen, P., Technology Review, 
42, 112, 1940.) 


One Average American 
is responsible for the 
annual consumption of 

Textiles ££ 30 Pounds 


Paper 


& 


250 Pounds 


Steel 


Food 


Oil Products 


Coal 



( D ). The utilization of resources by an average individual—a pictorial bar chart 
(Cohen, P., Technology Review, 43, 203, 1941.) 

Fig. 3. Four types of qualitative bar charts.— Continued. 
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Since the qualitative graph is usually drawn for the lajunan, it should 
be particularly clear, simple, and attractive. There are various types 
which satisfy these requirements. Which to choose for a particular case 


At. wt. 204 

1.5% 



(A). The stable isotopes of lead. ( Com¬ 
mittee on Atoms, International Union 
of Chemistry , Rev. Sci. Instruments , 
7, 334-335, 1936.) 



(B). The composition of the earth’s 
crust to the depth of 10 miles, in¬ 
cluding the lithosphere, the hydro¬ 
sphere, and the atmosphere. {Clarke, 
F. W., Data of Geochemistry, /,th Ed., 
p. 35, U. S. Geol. Survey Bull. 695, 
Washington, D. C., 1920.) 


Charge Product 



(C). Relative weights of materials charged into and produced by a typical blast 
furnace. 

Fia. 4. Three types of qualitative graphs for expressing percentages. 

depends somewhat upon the data, but often the choice is a matter of 
personal preference. Some common types of qualitative graphs are 
illustrated in Figs. 2 to 4. 
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5. The Quantitative Graph. A graph of the second or quantitative class 
ordinarily shows the relation between two related variables in the form 
of a regular curve, which may or may not be expressed mathematically. 
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The vast majority of graphs in this class are drawn on ordinary rectan¬ 
gular coordinate paper with uniform scale divisions (Fig. IB). Other 
pa pel’s in rather common use are the logarithmic or log-log (Fig. 5), the 
semi-log (Fig. 6), the polar (Fig. 7), and the probability (Fig. 8). Their 
characteristics as to arrangement of axes and spacing of scales are readily 
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seen. When the relation connects more than two variables, the nomo¬ 
gram (Fig. 9) is frequently a satisfactory form of graphical presentation. 



In certain cases trilinear paper (Fig. 10) can be used. These latter forms 
will not be discussed further. 

A graph, like any other tool, loses much in effectiveness when certain 
easily followed principles of construction are disregarded. There are 
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Fig. 7. 

A polar graph 

seven 

main steps 

relate 

to 


(a) i 


(b) ' 


(c) : 


W) 


(f) 


(/) 


(<j) 


function of angle of view. 


They 


choosing the coordinate scales, 
labeling the coordinate scales, 
plotting the data, 

fitting a curve to the plotted points, 
preparing a descriptive caption, and 
acknowledging the source of the data. 


(u) Choosing the Graph Paper. Important questions to consider here 


are: 


1. Is ordinary rectangular paper or log-log paper or something else 
the most satisfactory for the particular case under consideration? 


1 0.5 0.2 0.10.05 0.01 


THE QUANTITATIVE GRAPH 39 

2. Is there the necessary preciseness of separation of the coordinate 
lines? 


3. Are the lines not so close to one another as to be confusing, yet 
sufficiently numerous as not to require excessive interpolation? 



4. Is the paper of such quality that it will stand erasures and pos¬ 
sible frequent handling? 

5. Is the paper of the needed transparency or opacity, on the one 
hand, to permit of tracing or blueprinting or, on the other hand, to 
prevent the print on pages below from showing through? 
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Fig. 0. A nomogram relating object distances, image distances, and focal lengths of 
mirrors and lenses. The dotted line shows, for example, that an object 20 cm from 
a 30 cm focal length convex lens is seen through the lens as a virtual image 60 cm 
back of the lens. 



Fig. 10. A trilinear graph showing metallographic phases present in Fe—Mn—Ci 
alloys at 1830° F. (Burgess, C. O., atul Forgeng, IF. D., Metals Technology, 6. 1938 
Am. Inst. Mining Met. Engrs. Tech. Pub. 911.) 
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6. If the graphs are to be reproduced in print, are the coordinate 
lines black so that they may show up well or blue so that they may 
not show at all? 

7. Are the sheets of such size as not, on the one hand, to lead to 
cramped scales, to the elimination of significant figures which the data 
may justify, and to errors due to the finite widths of the plotted 
points and the lines that may be drawn; or, on the other hand, to 
lead to such large scales as to indicate an accuracy greater than that 
which the data justify? Often the need for a large sheet may be satis¬ 
fied by pasting together two or more small sheets. Sometimes the 
margin of a single sheet may be used to extend the scales a sufficient 
amount. 

’ (6) Choosing the Coordinate Scales. A poor choice of scales for the 
coordinates, more than any other single factor, will make an otherwise 
acceptable graph unsatisfactory as a tool. Such being the case, the need 
of suitability rules is evident. Although none can be given to fit all 
cases, where the maximum revelation of content of data plotted or the 
maximum of ease and comfort in the use of the plot as a tool are con¬ 
cerned, certain general rules may be stated. Granted the best selection 
of graph paper, experience has shown it generally desirable to choose 
the coordinate scales in accord with the following rules. 

Rule 1. The scale for the independent variable should be measured 
along the so-called x-axis. 

This rule is a statement of an established custom. Which of two 
variables shall be viewed as independent is usually greatly influenced, 
if not actually determined, by either the experimental procedure or the 
nature of the resulting data. Where in a process of measurement involv¬ 
ing two or more variables, the values for one are fixed arbitrarily and 
corresponding values of the others are then determined, the formei is 
generally regarded as the independent variable. At other times, which 
variable shall be so regarded is a matter of opinion. 

Rule 2. The scales should be so chosen that the coordinates of any 

point on the plot may be determined quickly and easily. 

No scale is acceptable if it is difficult to read. How much scales may 
differ in this respect is shown by (A) and (B) of Fig. 11, where extremes 
of readability arc presented. Compare the two curves for ease and accu¬ 
racy with which refractive indexes corresponding to wavelengths of 

0.47m, 0.65/h, etc., can be located and read. 

For rectangular graph paper with the space between successive main 
lines divided into ten equal small spaces, the most convenient scales are 
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those in which such distances between successive main lines represent 
a difference in value of one, two, four, or five units, or these values 
multiplied b}' 10” where n is an integer. Scales in which this distance 
represents three, six, seven, nine, or eleven units, etc., should seldom 
if ever be used. Other scales, corresponding to 1.25, 2.5, or eight units 
per main scale division may occasionally be found desirable. 



Rule 3. The scales should be numbered so that the resultant curve is 
as extensive as the sheet permits, provided the uncertainties of measure¬ 
ment are not made thereby to correspond to more than one or two of the 
smallest divisions. 

Coordinate scales need not, in fact generally do not, start from zero 
values. 1 he scale for each variable may well begin, in accord with this 
rule, at or just below the lowest rounded value in the data and end at 
or just above the highest. There is, however, no justification for extend¬ 
ing a scale to such an extent that the uncertainties for the values plotted 
correspond to more than one or two of the finer scale divisions (Fig. 12). 

Rule J t . Other things being equal, the variables should be manipulated 
to give a resultant curve which approaches as nearly as practicable to a 
straight line. 
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150 



0 



(B) 


Fig. 12. Showing over extension and under extension of a graph scale. In describing 
the performance of a generator, graph A exaggerates and graph B minimizes the 
accuracy. 



Fig. 13. Showing an advantage possessed by a differential graph. With p repre¬ 
senting 1 atmosphere and v„ 1 gmv/mole, curve A shows, for nitrogen at 0° C, 
Vo/v as a function of p/po, and curve B shows pv/p»i'o as a function of p/po- I he 
deviation from the ideal gas law is evident in curve B but not in curve A. (Micheli, 
Wouters, and de Boer, Bhysira (7), 1, 587, 1034.) 
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The straight line is the simplest curve to construct and to use. Where 
precision is a matter of concern, it is usually advantageous to plot, when 
possible, variables which cause the resultant curve to approximate a 
straight line. This is especially true when the graph is to be used for 
finding slopes or the constants of a rational equation by the methods to 
be described later. For example, if we wish to find the constants of an 
equation of state of the type 


pv = RT(1 -f- ap + bp 2 + cp 4 ) [1] 

a graph of p as a function of v (Fig. 13A) is of little value. If, however, 
the product pv is plotted as a function of p (Fig. 13 B) } the resultant 
curve will approximate a line whose deviation from the horizontal will 
show the first order deviation of the gas from an ideal gas, and whose 
deviation from straightness will show the second order variation from 
an ideal gas. 

Many other types of equation can be rectified. Thus, the equation 

B x = 0 B x e- c '- /m/T) -" /T ° )] [ 2 ] 

gives the Wien approximation for the spectral brightness, B x , of a black 
body at temperature T in terms of the value 0 B\ for a black body at 
a standard temperature, T 0 . If experimental values of In (B x ) are plot¬ 
ted against 1 /1 } the curve will approximate a straight line, since by 
taking natural logarithms of the original equation one obtains 


In (B x ) - In ( 0 £x) 


= - (T _ T 

x \r 0 t) 


[3] 


an equation linear in In (B x ) anti \/T. The departure of such an ex¬ 
perimental curve from a straight line (for any one of many non-black 
sources) is a measure of the deviation of the spectral emissivity of the 
source from constancy. Similarly, data thought to satisfy the Stein- 
metz law for work done in a magnetization cycle 

W = aB k [4] 

should give a straight line if log W is plotted as a function of log B. 
Many other equations may he handled similarly. (See Fig. 8.) 

Sometimes when the data fit a certain type of equation, a straight 
line graph can be obtained by plotting the measured variables on other 
than regular rectangular graph paper more simply than by manipulating 
the variables in some such manner as above. Thus, where the difference 
in temperature, 0, between a body and its surroundings at any time, t, 
is given by Newton’s law of cooling 



[5] 
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a cooling curve approximating a straight line may be obtained by plot¬ 
ting log 0 as a function of t. When semi-log paper is used, plotting 0 as 
a function of t suffices. This eliminates looking up and tabulating loga¬ 
rithms. This latter method, however, in view of suitability rules 3 above 
and 5 below, is often unsatisfactory, and especially so if the constants 
6 0 and a are to be evaluated. 

Rule 5. Scales should be chosen such that the curve shall , to the extent 

possible , have a geometrical slope approximating unity. 

The geometrical slope of a curve at a point is the tangent of the angle 
between the x-axis and the tangent to the curve at that point, and is 
different from the physical slope of the curve dy/dx at the point in 
question, whose value contains the units of the quantities plotted. The 
latter quantity does not depend on the scales chosen for plotting, while 
the former depends completely on the scales chosen. 

Though rather generally ignored, the rule is of great value where pre¬ 
cision is concerned. This is especially true when a graph consisting of 
a straight line, obtained in accord with rule 4, is to be used as a tool. 

With scales chosen as suggested above, it is often found that a curve 
results whose geometrical slope does not vary much from unity at any 
point. This is quite desirable, for then deviations of the plotted points 
from the line will show up most markedly. Conversely, the line to be 
drawn may be drawn most precisely. An illustration is furnished in 
Fig. 14 by the work of Hecht 1 and others in their important study of 
“Energy at the Threshold of Vision.” Using Fig. 14Z? leads to greater 
certainty of correct assignments of quantum numbers than does using 
Fig. 14 A. Doubters may well trace the base lines and the computed 
curves for n — 6 quanta on translucent paper and attempt to fit the 
curves to the other sets of data. On the other hand, if one wishes to 
cover up departures of observed plotted points from a line to be drawn, 
he should choose the coordinate scales so that the geometrical slope of 
the line to be drawn shall be far from unity. The main objection to 
the use of log-log and semi-log papers, noted under rule 4, depends on 
these considerations. Usually the scales which they force lead to geo¬ 
metrical slopes differing widely from unity, and automatically many 
variations are covered up. 

There are many cases where the precision of one coordinate is so low 
with regard to the other that nothing is gained by following the unity 
slope rule and where in the interest of economy of space one should 
deviate from the rule (see Fig. 12, also X-curve of Fig. 1 , p. 243). 

1 Hecht, S., Shaler, S., Pirenne, M. H., Science, 93, 585 (1941). 
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Fig. 14. Showing an advantage due to having an approximate geometrical slope of 
unity for the important portion of a line graph. The points graphed represent 
results obtained by three observers at the threshold of vision, using light whose 
wavelength coincides with the maximum of the luminosity curve of the eye, and 
show the fractional part of the time that flashes were perceived as a function of 
the average number of quanta of light received per flash at the cornea. The lines 
represent the expected responses of the three observers in case just 5 (n = 5), 
just 0, and just 7 quanta of the light used are required to produce just perceptible 
flashes. For the sake of separating the curves in graph B , 0.050 has been added to 
the observed log abscissa values for n = 6 and 0.350 for n = 7. That the expecta¬ 
tion curves are properly associated with the observed data is more evident when 
one makes use of graph B than when using graph A. ( Hecht, S., Shaler , S., an 
Pirenne, M. //., Science , 93, 585, 1941, and personal correspondence.) 



THE QUANTITATIVE GRAPH 


47 


(c) Labeling the Coordinate Scales. Scales are marked on graphs by 
labeling certain main coordinate lines with the values they represent. 
Not all main lines need be so marked. Often labeling every second main 
line results in the shortest time of location of a desired coordinate, and 
yields in addition the best general appearance for the graph. Whatever 
the plan, it should be uniform. One need not begin with the first line 
at the left or at the bottom of the graph unless the scale begins at zero, 
in which case the 0 should be recorded. It is suggested that the num¬ 
bers used in marking the scale contain as many significant figures as 
the data justify, or as are readable from the curve if, as is usually the 
case, the data are roughly equally accurate throughout. That is, 3.50 
may well be written instead of 3.5 when it is possible to distinguish 3.51 
from 3.50 in the data and on the plot. An essential part of a satisfactory 
scale designation is the inclusion along each axis of the name of the quan¬ 
tity represented and the units in which it is measured, e.g., Temperature 
in °K, Pressure in atmospheres, etc. When the logarithm of a quantity 
is being plotted, the units in which the quantity itself is measured should 
be stated, e.g., log of Radiancy in watts/cm 2 , although strictly speaking 
it is impossible to take the logarithm of anything but a pure number. 

(d) Plotting the Data . Plotting the points to represent the data at 
hand is a simple process, but it should be done carefully if an accurate 
tool is desired. If the data to be plotted are experimental or computed 
and subject to computational errors, each point should be indicated by a 
suitable symbol, such as a cross (x) or a circle (O). Different sets of 
data on the same graph should be denoted by different symbols if there 
is a possibility of confusion otherwise. When computed data subject 
to negligible computational errors are plotted, the curve necessarily 
passes through all points plotted and nothing is gained by indicating 
plotted points. The point symbols should be omitted in such cases. 

(e) Fitting a Curve to the Plotted Points. Two types of cases are to be 
considered. In one, owing to the fewness of the observed points, the 
uncertainty as to the law of dependency of the assumed dependent vari¬ 
able on the assumed independent variable, or the possibility of unknown 
variables entering, the plotted points are connected by straight lines. 
(Fig. 15.) 1 In the other type, sufficient points are assumed present to 
justify drawing a smooth continuous curve to represent the actual vari¬ 
ation of the related variables under consideration in the regions between 
the plotted points. For these cases the curves are generally so drawn. 
What is said here applies almost wholly to this type. 

1 Hardy, J. D., and DuBois, E. F., “The Significance of the Average Temperature 
of the Skin,” p. 537 of report of symposium on Temperature—Its Measurement and 
Control in Science and Industry , New York, Reinhold Publishing Corporation, 1941. 
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Proficiency in judging the most likely course of a smooth curve 
through a set of plotted points requires practice. In the case of a 
single-valued function one may always include all plotted points on a 



Fig 15 Illustrating the irregular broken line graph. Data, obtained with subjecs 

in a calorimeter, show variations in the temperatures of various portions of the 
human body with different environmental temperatures. (Du Bois, E. F., Bepor 
on the Temperature of the Human Body in Health and Disease, in the symposium on 
Temperature, Its Measurement and Control in Science and Industry, p. 24, New Yor , 
Reinhold Publishing Corp., 1941.) 

single smooth curve of many inflections. It is absurd, however, to think 
that, such a curve will represent the true relation between y and x, for 
many curves can be drawn which will pass through the plotted points 
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Usually a much better curve for representing the relation sought is 
obtained by following the principles listed below. 

1. The curve should be smooth, with few inflections. 

2. The curve should pass as close as reasonably possible to all of 
the plotted points. 

3. The curve need not pass through a single point, much less 
through either of the end points. Very often they are end points 
because of limits in the accurac} r of the instrument or of the method 
used. In such cases less weight should be given to them than to the 
other points of the plot. 

4. The curve should usually, but not always, contain no inexplic¬ 
able discontinuities, cusps, or other peculiarities. 

5. When taken in moderate-sized groups, about one-half of the 
plotted points of each group should fall on one side of the curve and 
the other half on the other side. 

In addition to the pencil or the pen, transparent frames such as the 
ordinary so-called celluloid triangles, irregular curves, and ships curves 
are desirable for curve-drawing. In place of the last-named instrument, 
certain adjustable curves may often be conveniently employed. The 
transparency feature is of decided importance in connection with the 
application of the principles stated above. 

Granted the desired instruments, the procedure to follow in locating 
and drawing the best curve consists of (a) locating with the unaided 
eye, or, perhaps with the aid of fixed transparent frames, certain points 
through which or close to which it seems that the curve should be 
drawn; (6) drawing lightly through the selected points, in pencil and in 
a preliminary way, one section of the curve and then successive adja¬ 
cent sections; and (c) drawing the desired curve in its final form, chang¬ 
ing where necessary the lightly drawn preliminary curve in accord with 
the principles stated above. 

In the drawing of both the preliminary and final curves, when a shift 
or a change of a frame is made, one should see that the frame in the 
adjacent shifted position permits of the smooth joining on of the new 
section without a sharp change of slope at the junction. The satis¬ 
factory carrying out of this procedure may be readily judged by the 
squint test. In making this test, the eye is held close to the plane of 
the graph sheet in such a manner that one can sight along the curve. 
If the adjoining sections have not been correctly matched, a sudden 
change in direction of the curve will be quite noticeable. Figs. 16 A and 
16 B represent the same data. As regarded ordinarily, both curves seem 
smooth and satisfactory. The squint test, however, reveals that one 
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Fig. 16. Showing two graphs which differ in that, as revealed by the squint tes 
the curve of A shows a kink while the curve of B does not. When slopes of curves 
are determined graphically such kinks are dangerous and may lead to erroneous 
conclusions. See discussion relating to Fig. 2 of Chapter XI. The data p o ec 
show the emf of Rh vs. Pt as a function of the temperature of the hot junction. 
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of the curves fails to pass the test. Where the curve is to be differ¬ 
entiated graphically, the need for its application is great. As will appear 
in Chapter XI, a suspected kink in a graph of the data of Fig. 16 was 
the source of a difference of opinion that was later settled by least- 
squares treatment. 



Log B in Millilamberts 


Fig. 17. A combined graph, as presented by Hecht, showing for various individuals 
the brightness discrimination factor SB B as a function of the logarithm of the 
brightness B. 

Kinks in curves are not always to be avoided. Their presence may 
reveal important processes or changes of process. An interesting case is 
furnished by the work of Hecht. 1 It concerns the explanation of the 
observed variations in brightness discrimination, AB/B, where A B rep¬ 
resents the least perceptible change in the brightness B , as a function of 
that brightness. Results of previous reliable work relating to what is 
commonly referred to as the Weber-Fechner law was combined in a single 

1 Hecht, Selig, Proc. Nall. Acad. Sri. ( S., 20, 644 (1934); J. Psychol. (6) 33, 161 
(1936). 
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graph (Fig. 17). Except perhaps for the results of Aubert, there seems 
no indication of a kink or break in the curve. By the proper choice of 
scales and with the aid of an assumed explanatory law, Hecht, however, 
found significant breaks in the data for each observer and made them 
obvious. We here consider the observations reported by Blanchard. 1 
His data, disregarding for lack of space the value for the lowest bright¬ 
ness, are replotted in Fig. 18 on the same basis as for Fig. 17, but with 
scales so chosen that the presence of a kink or break might well show up. 
Except for the single value of A B/B corresponding to —3.17 for log B, 
there seems to be no indication of a break. Most workers in this field 
passed over it as just another rather unsatisfactorily determined point. 
Hecht, however, believing that the two types of visual processes corre¬ 
sponding respectively to the cone and the rod receptors of the retina 
might well follow different laws, sought for indications in such brightness- 
discrimination curves. With log A B/B rather than A B/B graphed as 
a function of log B (Fig. 19), the evidence became unmistakable. Not 
only that, but there were verified the two theoretical equations, 


AB 

B 


= C ( 


1 + 




which with properly chosen values for c and K holds for the rod or low- 


brightness region, and 

AB 

B 


1 + 




which similarly holds for the cone or high-brightness region. The kink, 
which with the proper function graphed became a break, is highly im¬ 
portant here. Without doubt other similar breaks are waiting for 

discoverers. 

When the curve to be drawn is known or judged to be a straight line, 
its course may be located by moving about among the points a stretched 
black thread, the straight edge of a transparent frame or, best of all, a 
straight line scratch on the under surface of a transparent frame. In 
any case the final line should be drawn with the aid of a straight edge. 

If a curve is to be used for the exact determination of corresponding 
values of y and x, or if it is to be used for obtaining highly precise deriva¬ 
tives, it is necessary to make the curve as fine a line as is practicable. 

Some authors, in drawing curves among plotted points, draw them in 
segments, with a break occurring wherever the curve if continued would 
cut through a point symbol. The questionable argument in its favor seems 

1 Blanchard, Julian, Phys. Rev., 11, 81 (1918). 



THE QUANTITATIVE GRAPH 


53 



Fig. 18. A graph similar to Fig. 17, but with much more favorable scales for showing 
kinks or breaks, in which only data by Blanchard are regraphed. ( Blanchard, 
Julian, The Brightness Sensibility of the Retina, Pliys. Rev., 11, 81, 1918.) 



Fid. 19. Showing, as presented by Hecht, the data of Fig. IS replotted with log 
(AB/B) rather than A B/B as a function of log B. The open circles represent data 
obtained by Blanchard in 1918, the full circles added data obtained by Lowry in 
the same laboratory in 1931. The full line curves represent the predictions of 

Eqs. 6 and 7. 


< 
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to be one of artistic appearance. For the qualitative graph, that suf¬ 
fices. For the quantitative graph, however, it seems wise to continue 
the curve as a line regardless of the point symbols intersected. Where 
the squint test is of value, the curve must continue thus uninterrupted. 

(/) Preparing a Descriptive Caption. The caption accompanying a 
graph when completed should include an accurate description of what 
the graph is intended to show. How complete this should be is some¬ 
what a matter of opinion. If the graph is to be a part of a publishable 
report, it should be remembered (1) that graphs and tables are often 
the portions of an article which excite the interest of a possible reader; 
(2) that time is saved in the reading of an article if suitable descriptive 
•captions are found adjacent to the figures; (3) that certain material 
incorporated in a caption may appropriately be left out of the body of 
the text; and (4) that in referring to a paper some time after a reading, 
a reader hopes to find certain quantitative data that it contains in its 
figures and tables, and that a search in the body of the paper for that 
which may appropriately be placed in a caption is likely to be a source 
of irritation. On the other hand, one can hardly include the whole of 
the text in figure and table captions. 

(g) Acknowledging the Source of the Data. Wherever the data for a 
graph are taken from a published report or the work of another, the 
source should be plainly stated in the caption. An exception occurs 
where the data have been widely published, e.g., the Maxwellian distri¬ 
bution of molecular speeds for a gas. Wherever a graph by itself is pre¬ 
sented as a report, it should carry the name of the author and an appro¬ 
priate date. 

6. Summary. As devices for presenting data, graphs have many 
advantages over other forms of presentation. Two classes of graphs are 
considered: the qualitative, including those intended for a convenient 
and picturesque way of presenting data, and the quantitative, including 
those intended for use as tools, either in research or in operating or con¬ 
trolling mechanisms or processes. 

There are many types of qualitative graphs which possess the attri¬ 
butes of clarity, simplicity, and attractiveness desirable in graphs of 
this class. Regardless of type, each such graph should contain an 
appropriate and complete descriptive caption. 

Though the quantitative graph usually takes the form of a regular 
curve, there are many different types in this class since the curve may 
often be plotted on any one of about six different general types of papers. 
The quantitative graph should be carefully drawn and certain general 
principles of good construction should be followed. These principles are 
listed and discussed in detail for each of seven main steps in the prepara- 

1 


4 
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tion of a satisfactory graph: (1) choosing the graph paper, (2) choosing 
the coordinate scales, (3) labeling coordinate scales, (4) plotting the 
data, (5) fitting a curve to the plotted points, (6) preparing a descriptive 
caption, and (7) acknowledging the source of the data. 

PROBLEMS 

1. Following the instructions given in the text, and using the data given below 
showing the radiancy of tungsten 1 as a function of temperature, plot curves showing 
(R = f(T) on ordinary rectangular graph paper, (R = f(T) on log-log paper, and 
log (R = /(log T) on ordinary rectangular paper. 


T 

(R 

T 

61 

1600°K 

7.74 watts/cm 2 

2400° K 

55.70 watts/cm 

1800 

14.15 

2600 

80.6 

2000 

23.65 

2800 

112.5 

2200 

37.20 

3000 

154.5 


2. Using the following data 2 showing the brightness of incandescent tungsten as a 
function of temperature, plot with care four curves on one or more two-page sized or 
larger sheets of rectangular graph paper. Use ships or other equivalent curves and 
apply the squint test. For the first graph plot B = f(T ); for the others plot 
log B = /(log T), but choose the coordinate scales to yield approximate geometrical 
slopes of 1.0, 0.5, and 0.25. Keep this plot for use in a graphical differentiation 
problem in Chapter IV. 


T B T B 


2000° K 

20.0 c/cm 2 

2600°K 

345 c/cm 

2100 

35.9 

2700 

495 

2200 

61.0 

2800 

690 

2300 

100.1 

2900 

950 

2400 

156.0 

3000 

1270 

2500 

234.0 




1 Forsythe, W. E. t and Watson, E. M., J. Optical Soc. Am. 24 , 114 (1934). 

2 Idem. 
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REPRESENTATION OF DATA BY EQUATIONS 

1. Introduction. It is often desirable to express in equation form the 
relationships between variables which may be suggested by graphs or 
tables. On the one hand such a derived equation or one or more of its 
coefficients may represent the objective of a research. On the other 
hand, it may be desired as an aid to differentiation, integration, or inter¬ 
polation. Moreover, an equation is a compact, easily remembered, and 
convenient form for the presentation of data. Methods for obtaining 
such equations will be discussed here. However, only forms involving 
one dependent variable will be treated. Periodic curves will be taken 
up in Chapter V; distribution functions for statistical data in Chapter 
VII. 

2. Rational and Empirical Equations. An equation for representing 
experimental data is said to be rational if it is derivable theoretically. 
For example, the equation 

. d 

q — a sin - 

2 

relating the throw, d, of a ballistic galvanometer to the electric charge, 
q , causing the throw, is rational, since it is based on established physical 
laws. In this case the finding of an equation reduces to the finding of a 
value for the constant, a. 

An equation for representing experimental data is said to be empirical 
if its form has not been derived theoretically. In the process of obtain¬ 
ing such an equation, one must first find a suitable form. Given that 
form, the further procedure becomes the same as that for the rational 
equation. 

3. Choosing a Suitable Form for an Empirical Equation. The ideal 

empirical equation is one that represents the experimental data closely, 
yet has only a few arbitrary constants—two generally opposing charac¬ 
teristics. As a consequence a choice must sometimes be made involving 
a sacrifice either of simplicity or of precision of fit. On the other hand, 
a choice must sometimes be made from two or more functions which, 
in a given case, approach the ideal form about equally. There is no 
straightforward method of obtaining a most suitable function for a given 
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11 
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(O). 1 / — (x — 1 /. 

Fias. 1-G. Graphs illustrating frequently used equations. 
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set of data. Usually one simply plots the data, represents them approxi¬ 
mately by means of a curve, and, guided by experience and a knowledge 
of analytic geometry, makes a guess as to the form of the equation. If, 
on being tested, this form is found unsatisfactoiy, a new guess is made 
and tested. This process is repeated until one is satisfied. With the 
ease and precision of such testing in mind, it is usually advisable, where 
possible, to select coordinates which yield as nearly a straight line as 
possible. 

The selection of such coordinates and the drawing of a best curve 
whose equation is sought brings up the question of the changed relia¬ 
bilities (more precisely weights) assigned, in effect, to the various plotted 
points, which accompany changes of coordinates. The significance of 
weights, how coordinate changes affect them, and the account that 
should be taken of changed weights will be discussed in Chapters IX 
to XI. 

To assist the less experienced, the curves of Figs. 1 to 6 are presented as 
examples of the shapes of curves which may be obtained from several of 
the more common types of equations by varying the arbitrary constants. 

4. Testing the Suitability of an Empirical Function to Represent a 
Set of Data. Fortunately, one need not evaluate the constants for a 
particular form of equation to see whether or not that form fits the data 
satisfactorily. Certain preliminary tests often not only give the infor¬ 
mation desired, but help later on when the constants are to be calculated. 
For simple types of equations with only one or two arbitrary constants, 
the following graphical test is convenient. For more complex forms, a 
tabular test may be used. 

(a) The Graphical Suitability Test. The procedure here consists of 
three steps. 

1 . Write the assumed relation, /(.r,y,a,6) = 0 , in a form that is 
linear with respect to two selected functions, F\ and F 2i which do not 
include the arbitrary constants, a or 6, thus 

Fx = A + BF 2 [2] 

Of these two functions, often one may involve x only while the other 
involves y only, and the new constants A and B will be functions of 
a and b only. 

2. Calculate F x and F 2 for a few, four say, widely separated pairs 
of values for .r and y. 

3. Plot F 1 as a function of F 2 . Insofar as a straight line is obtained, 
the assumed equation would' seem to be satisfactory. Greater cer¬ 
tainty is obtained by taking into account the remaining pairs of F 1 
and F 2 . 
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To illustrate, we shall use the method to determine whether or not 
the data of Table I may be represented by an equation of the form 

i y = aebx [3] 


TABLE I 

Data for Illustrating a Graphical Test for the Suitability of an Empirical 

Function 


X 

l 

2 

3 

4 

5 

6 

7 

8 

9 

y 

1.78 

2.24 

2.74 

3.74 


5.31 

6.92 

8.85 

10.97 

log y 


0.350 

0.438 

0.573 

0.648 

0.725 

0.840 

0.947 

1.040 

y c 

1.76 1 

2.21 

2.78 

3.51 

4.39 

5.52 

6.93 

8.71 

10.94 


Eq. 3 written in a form similar to Eq. 2 becomes 

log y = log a + (b log e)x [3a] 

in which log y corresponds to F i, x to F 2y log a to A, and (b log e) to B. 
Plotting log y for four selected points, marked by o in Fig. 7, as a func¬ 
tion of x, a straight line results. The choice of Eq. 3 seems satisfactory 



Fig. 7. A plot for testing whether Eq. 3 fits the data of Table I. 

for representing the given data. This conclusion is verified by the fur¬ 
ther plotting of points and finally by comparing the observed ?/-values 
with the computed values (shown as y c in Table I) eventually obtained. 
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Methods for determining the constants of the equation y c = f(x) are 
given below. 

Certain two-constant equations, such as y = a( 1 — e bx ), y = x a + bx, 
etc., which cannot be written in the form of Eq. 2 cannot be tested by 
this method. Among those which can, however, be so tested are 


y = ax 

[4] 

y = a -f bx 

[5] 

II 

a 

N 

[0] 

y = ae bx 

[7] 

y = ax b 

[8] 

X 

V = . , 

a -f bx 

[9] 

y = e (a+bz) , etc. 

[10] 


(b) The Tabular Suitability Test. When more than two arbitrary con¬ 
stants are involved, a tabular method is convenient for testing an as¬ 
sumed equation form. The procedure depends on the equation assumed, 
but in general it consists of (a) making a plot of the experimental data, 
( b ) constructing a table from the graph, (c) forming certain successive 
differences, and (d) examining the final set of differences for approximate 
constancy, the criterion of suitability for the assumed equation. 

For data already in a suitable tabular form, steps a and b are unneces¬ 
sary. Procedures and criteria for testing several of the more common 
types of equations are given in Table II. 

Just what successive differences are to be obtained is not difficult to 
determine. Consider case 1 of the table. If 

y = a + bx + cx 2 + dx 3 [11] 

then also 

y + Ay = a + b(x -j- Ax) + c(x -f Ax) 2 + d(x + A.r) 3 [12] 

and 

Ay = (bAx + cAx 2 -f dAx 3 H— •) + (2cA.r + 3f/A.r 2 H— • )x 

+ (3dAx -f • • -)x 2 [13] 

Since A.r is to be kept constant during the test, Eq. 13 takes the form 

Ay = a' + b'x + c'x 2 [14] 

of which a', b', and c' are constant. 



TABLE II 

Procedures and Criteria for Testing the Suitability of Various Assumed Forms of Equations to Represent Given Data 
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Repetition of the above procedure leads similarly to 


and finally to 


A 2 y = a" + b"x 
A 3 y = a'" 


[15] 

[16] 


This last equation shows that, if Eq. 11 holds and Ax is maintained con¬ 
stant throughout, the third-order tabular differences will be constant. 
Conversely, if such third-order tabular differences are found constant 
except for uncertainties of measurement, etc., the data may be repre¬ 
sented by Eq. 11. 

TABLE III 


Tabular Test for the Suitability of an Equation of the Form y = a -f bc z 

to Represent Certain Observed Data 


Observed Values 

Taken from Graph 

Computations of 

Successive Differences 

X 

y 

X 

y 

Ay 

log (Ay) 

A log (Ay) 

0.50 

17.3 

0 

16.G 






% 


1.3 

0.114 


1.75 

19.0 

1 

17.9 

1.6 

.204 

0.090 

2.75 

21.0 

2 

19.5 

2.0 

.301 

.097 

3.50 

22.5 

3 

21.5 

2.4 

.380 

.079 

4.50 

25.1 

4 

23.9 

3.0 

.477 

.097 

5.25 

28.0 

5 

26.9 

3.7 

.568 

.091 

0.00 

30.5 

6 

30.6 

4.5 

.653 

.085 

0.50 

33.0 

7 

35.1 

5.7 

.756 

.103 

7.50 

38.0 

8 

40.8 





As inspection will show, the underlying theory for the other cases of 
the table is much the same. Consider case 7. The equations corre¬ 
sponding to Eqs. 11 to 16 are 

y = a -f- be c ' x [17] 

v + Ay = a + 6c c ' (jr+ - ix) = a + be c '^e c ' x [18] 
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Ay = be c ' x (e c ' AX — l) [19] 

In Ay = \n[b(e c '* x — 1)] + c'x = b' + c'x [20] 

A (In Ay) = c'Ax = b" [21] 

Many other functions may be handled similarly. In the case of still 
other functions, there seems no possibility of such treatment as a cri¬ 
terion of suitability of equation form, e.g., 

y = ae~ bx + ce+ dx [22] 


36 


32 


y 


24 


Fia. 8. A plot constructed to test the suitability of Eq. 23 to represent the data in 

the first two columns of Table III. 

To illustrate the use of Table II, we shall test whether or not an 
equation of the form 

y = a + be 1 [23] 

can suitably represent the data in the first two columns of Table III. 
We first plot y as a function of x (Fig. 8). Then, using the curve, we 
list values of y corresponding to equally spaced values of x (Table III). 
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Next we obtain, in turn, the successive differences, Ay, log (Ay), and 
A log (Ay). The values of A log (Ay) are essentially constant, indicating 
for Eq. 11a certain suitability of choice. 

6. Evaluating the Arbitrary Constants. Once a satisfactory form of 
equation has been chosen, or, in the rational case, derived, the problem 
has been reduced to finding suitable values for the constants. Numer¬ 
ous procedures, varying in ease and in accuracy, are available. The 
most accurate is the method of least squares, discussed in detail in Chap¬ 
ter XI. Since it ordinarily involves much computation, other methods, 
less accurate but also less cumbersome, are very much used. Frequently 
one of these methods is used to give an approximate result which may 
be later improved by the successive approximation method or, in cases 
where the labor is justified, by the method of least squares. If it is 
known in advance in any case that either the successive approximation 
or the least-squares method is to be used finally, considerable time may 
often be saved bv definitely dealing at first with only rounded con¬ 
venient values for the desired constants. 

(a) Straight-Line Graph Method—Equations with Two Arbitrary Con¬ 
stants. For the simple equation with one or two arbitrary constants, 
the constants can be evaluated by a continuation of the graphical test 
for suitability outlined above. r \ he method is best explained by an 
illustration. If was shown that the data of Table I may be represented 
by V = ae bx because log y plotted against a; gave a straight line. The 
slope of this line is (b log e). The intercept on the (log r/)-axis is log a. 

From Fig. 7, the slope is found to be 0.0991, and the intercept, 0.147, 
whence 


and 



0.0991 0.0991 

log c ~ 0.4343 “ °' 228 

a = 10° 147 = 1.403 




The final form of Eq. 3 is, then, 


y = 1.403c°- 228x [26] 

Values of y calculated with the aid of this empirical equation (listed in 
Table I as y c ) agree well with the listed values for y. 

In obtaining the slope of the line, the familiar two-point formula 



may be used. Here (x\ 9 yi) and (x 2 ,yo) may be any two points on the 
line, but for greatest accuracy they should be as far apart as practicable. 
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For convenience they may be taken as the intersections of the curve 
with two main x-coordinate lines, so that (x 2 — Xi) shall be a convenient 
divisor. Similarly, the intercept, a, when it cannot b'e read directly 
from the plot, can be calculated by the two-point formula 



The advantages of using the same two points in evaluating a and b are 
obvious. Those familiar with the general determinant method of find¬ 
ing equations will conveniently substitute the given values for x and y 
in the determinant equation 

V x 1 

?/i xi 1 = 0 [29] 

V 2 x 2 1 

and simplify. 

The extension of the above method to Eqs. 4 to 10 listed above should 
be evident. 

(6) The Straight-Line Graph Method—Equations with Three Arbitrary 
Constants. To evaluate the constants of a three-constant equation by 
the straight-line graph method, one must first eliminate one of the con¬ 
stants and then treat the resultant two-constant equation as described 
above. The scheme to be used in eliminating a constant depends on the 
type of equation being fitted. Methods follow for three of the most com¬ 
mon types of equations 

y = a + bx + cx 2 [30] 


y = a + bx c [31] 

and 

y = a -f- bc x [32] 

For straight-line methods of treating other three-constant and many 
four-constant equations, the reader is referred to more complete sources. 1 

(1) y = a -f bx + cx 2 

The equation is that of a parabola, of which a is the ^-intercept. If 
data are given close to x = 0, or if the y = f(x) curve may be safely 
extrapolated to the y- axis, a may be determined directly. It is then a 

1 Running, T. R., Emjnrical Formulas , New York, John Wiley & Sons, 1917. 
Lipka, J., Graphical and Mechanical Compulation, New York, John Wiley & Sons, 

1918. 
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simple matter to treat ( y — a) as a new variable, y' say, and to evaluate 
b and c, as shown above, using the form . 

- = b + cx [33] 

X 

When a cannot be thus evaluated, we may possibly shift the origin of 
the coordinate system to some convenient point (x 0 , yo) in the neighbor¬ 
hood of the actual plotted points, through which it has been decided that 
the curve shall pass. The coordinates (x', y') of the observed points in 
the new system are given in magnitude by (x — x 0 , y — y Q ). Since the 
curve now passes through the origin it takes the form 

y ' = b'x' + cV 2 [34] 

which may be rewritten as 

-, = b’ + c'x’ [35] 

X 

Values for b' and c' are found from a plot of y' lx! = fix'). Then c, b, 
and a are given by 

c = c' [36] 

% 

6 = 6'- 2c'x 0 [37] 

and 

a = y 0 — b'x 0 + c'x 0 2 [38] 

The method will not be illustrated, since it is generally less acceptable 
for parabolic equations than the selected-points method, combined, if 
necessary, with the successive-approximation method. 

(2) y = a + bx c 

Here the constant a represents the ^-intercept of the curve if c is posi¬ 
tive, or of an asymptote parallel to the x-axis if c is negative. It may 
sometimes be obtained directly from the y = f(x) curve. Usually a 
satisfactory value cannot be so obtained, and we must evaluate or 
eliminate it by some alternate method. Probably the simplest suitable 
method of evaluation proceeds as follows. 

Select from the experimental curve, three widely separated points, 
(* 2 , 3 / 2 ), and (.r 3 , 7 / 3 ) such that 

*3 = (*i** 2 ) H [39] 

Then 

bx 3 C = (bx l c -bx 2 c ) yi 
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or, since for every point on the curve, bx c = y — a 


whence 


2/3 - a = V (y Y - a) (i /2 ~ a) 


a = 


2/i2/2 - 2/3 
2/i + 2/2 “ 2y 3 


[40] 


We may then treat (y — a) as a new variable, y\ and write Eq. 31 as 


y' = hr' 


[41] 


for which b and c can be evaluated by the straight-line graph method 
for two constants. If the plot log y' = /(log x) is concave downward, 
the computed a is too small, and vice versa. Corrections for such errors 
may be obtained by the method of repeated trials. 

(3) y — a ~\~ bc x 

When this type of equation fits the data, the value of a cannot be 
read directly from the curve of y — f(x). It can, however, be calculated 
as follows. 

Choose three widely separated points on the curve such that 


Then 


x 3 = + x 2 ) 

(logc)x 3 = ^[(logc)X! + (log c)x 2 ] 


[42] 

[43] 


or, since for any point on the curve, 


(log c)x = log 


(y ~ o) 


[44] 


, (2/3 - a) i [\ ( 2 /i - n) , (2/2 “ a) 

log —y— = 5 [ log —+ log —j 



, lyi ~ a 2/2 - a 

- log V 6 6 

[45] 

Hence 

and 

y 3 - a = V(yi - a) (y 2 - a) 

[46] 


2/i 2/2 “ 2/3 

2/i 4" 2/2 ~ 22/ 3 

[47] 

As before, 

we may then set {y - a) = y', whereupon 



2/' = bc x 

[48] 


for which b and c may be evaluated by the straight-line graph method 
for two constants given above. If in the plot of log y' = f{x), the line 
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is slightly concave downward, the computed a is too large, and vice 
versa. As before, corrections for such errors may be obtained by the 
method of repeated trials. 

(c) Method of Selected Points. The procedure of this method consists 
of four steps. 

1. Plot y as a function of x and fit a smooth curve as carefully as 
is needed. 

2. From the curve choose a number of points equal to n, the num¬ 
ber of arbitrary constants in the equation selected to represent the 
data. For convenience these points should lie on main ^-coordinate 
lines; for accuracy they should be widely separated without lying at 
the relatively uncertain extremes of the curve. 

3. Substitute in turn each of these n pairs of x- and ^/-values into 
the chosen equation, thus obtaining a set of n equations with n un¬ 
knowns. 

4. Solve these n equations simultaneously for the unknowns, i.e., 
for the desired arbitrary constants. 

When the chosen equation is transcendental with three or more arbi¬ 
trary constants, step 4 may prove to be very difficult. When, however, 
the equation is, or can be made, linear with respect to its arbitrary con¬ 
stants, the procedure may be simplified by the use of determinants. 
Steps 3 and 4 then combine to a single step. 

Illustrating the simplified procedure, consider the curve of Fig. 9, for 
which an equation linear with respect to its arbitrary constants, of the 
type 

y = a + bx -b cx 2 [49] 


is desired. The first step of plotting has been carried through. As the 
second step, we select the points where the curve crosses convenient 
.r-coordinate lines at 4, 8, and 12. The corresponding ^-coordinates are 
8.1, 12.8, and 16.0. As the third and fourth steps combined, we write 
the determinant equation 


y 

1 

X 

O 

X 

8.1 

1 

4 

16 

12.8 

1 

8 

64 

16.0 

1 

12 

144 




Simplified, this determinant yields 


y = 1.90 + 1.738.r - 0.0469.r 2 


[51] 
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as the equation sought. Equations thus derived should always be tested 
for errors and for goodness of fit. Substitutions, accordingly, of 4, 8, 
and 12 for x show that no computational error has been made in obtain¬ 
ing Eq. 51. However, tests for .r = 2 and x = 16 yield values for y 
that do not check with the curve as drawn. Two possible conclusions 
may be drawn. (1) It is dangerous to extrapolate beyond observed 
regions. (2) Perhaps the desired form of equation is not capable of 



Fig. 9. A parabolic curve whose constants may be evaluated by the selected points 

method. 

satisfactorily representing the data, and one should try another form. 
Reference to Figs. 1 to 6 reveals a similar curve in curve A of Fig. 6 and 
suggests that an equation of the form 

y — a In x [51a] 

might satisfy. Actually, however, additional terms, similar to those of 
Eq. 51, are needed for a satisfactory representation. 

Essentially the same procedure may often be used for less obvious 
cases where linearity with respect to the arbitrary constants themselves 
does not exist, but where linearity with respect to certain functions of 
those constants does exist. Where the desired equation is of the form 


y — a sin (cot -f- 4>) 


[52] 
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with y and at as variables and a and <f> as the unknown constants, a 
change of form yields 


y = a cos <f> sin at + a sin $ cos cot 



of which a cos <t> and a sin </> are now the unknown constants in linear 
form. As such they may be obtained easily by using the above method. 
To obtain separate values for a and <f> thereafter, we make use of the 
two obvious relations 


and 


a = (a 2 cos 2 <f> -f* a 2 sin 2 <£)** 


[54] 


—! a sin (f> 

<t> = tan - 

a cos <}> 



Where the desired equation is, for example, of the type 

V = ae (6x+cx2 > [5G] 

linearity with respect to arbitrary constants may be obtained by chang¬ 
ing the form of the equation to 


In y = In a + 6* -f- c* 2 [57] 

Obviously, determining In a is equivalent to determining a. For equa¬ 
tions like Eq. 56 which are made linear by writing them in linear form, 
it will usually prove advantageous in step 1, to plot In y as a function 
of x rather than to plot one variable as a function of the other. 

As a second example illustrating this very important method, let us 
fit Eq. 56 to the data of Table IV by the method of selected points. 
An examination of the range of y-values in Table IV shows the im¬ 
practicability of trying to draw a curve of y = f{x) from which to choose 
the points with sufficient accuracy. Hence, we follow the suggestion of 
the previous paragraph and write the equation in the linear form of 
Eq. 57, or, even better for computational purposes, in the form 

log y = log a + (0.43436)* + (0.4343c)* 2 

= a' + b'x + c'* 2 [58] 

We then tabulate values of log y and plot them as a function of *, Fig. 
10. Remembering the convenience and accuracy suggestions of step 2 
above, we select the three points (0.250,0.356), (0.550,1.031), and 
(0.850,2.158). If, further, we make the simplifying substitutions 



* - 0.550 
0.300 



and 


2 = log y — 1.031 


[60] 
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we obtain a simple expression capable of easy evaluation, namely 

z lx' x' 2 
—0.675 1 -1 1 

= 0 [61] 

0 10 0 
+ 1.127 1 1 1 



Fia. 10. A plot showing log y = f(x), Table IV, for obtaining an equation by the 

selected points method. 


To one familiar with determinants, inspection yields the solution 



/ 1.127 + 0-675 

V 2 




= 0.901i' + 0.226x' 2 


[62] 
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Substituting for 2 and x' in accord with Eqs. 59 and 60, we obtain 


and 


log y = 0.1388 + 0.241 lx + 2.511 lx 2 [63] 


y = 1 377e (0 - 5552jr + 5.7S2x 2 ) 



TABLE IV 

Data for Illustrating the Selected Points Method of Finding an Empirical 

Equation 


|The prime of i/ c is intended to indicate that these computed values are first approximations only) 


X 

V 

log U 


log y'c 

log y - log y'c 

0.125 

1.595 

0.2028 

1.615 

0.2082 

-0.0054 

.250 

2.239 

0.3500 

2.269 

0.3559 

- .0059 

.325 

2.995 

0.4764 

3.037 

0.4824 

- .0060 

.450 

5.626 

0.7502 

5.698 

0.7557 

- .0055 

.575 

12.97 

1.1069 

12.81 

1.1076 

- .0007 

.675 

27.92 

1.4459 

27.90 

1.4455 

4- .0004 

.750 

53.88 

1.7314 

53.95 

1.7320 

- .0006 

.850 

141.7 

2.1514 

143.8 

2.1579 

- .0065 

.925 

320.8 

2.5062 

323.8 

2.5103 

- .0041 

.975 

571.3 . 

2.7569 

576.7 

2.7610 

- .0041 


Values of y and log y calculated by Eq. 64 are given in Table IV in 
the columns headed y' c and log y' c . Inspection shows that the com¬ 
puted log y' c values are uniformly too great. A value of log a less by 
0.0038, yielding 1.365 for a itself gives a much better check between y 
and y' c . However, even with the suggested change, it is evident that the 
fit is not as satisfactory as it might be. With the —0.0038 change as¬ 
sumed made, values of log y — log y' c are uniformly too great for low 
and for high values of x and too small for intermediate values. The 
further application of the successive approximation method, as shown 
later, yields corrections which eliminate this tendency. 

For equations with more than two arbitrary constants, the method 
of selected points is recommended whenever applicable, for it is gener¬ 
ally simpler to carry through than the straight-line graph method, and 
more accurate than the method of averages to be described. 

(d) Method of Averages. This method is a selected-points method based 
on a particular method of selecting points, which can be used only when 
the type of equation dealt with is linear with respect to its arbitrary 
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constants; i.e., when the equation may be written in the form of Eq. 
49. It is also known as Norman Campbell’s zero-sum method, 1 so called 
because, for the straight line, it yields zero as the sum of all the devia¬ 
tions. For this case with points randomly and similarly distributed 
with respect to the straight line to be drawn, this method yields results 
comparable with those obtained by the least-squares method (Chapter 

XI). 

The procedure for the equation, y — /(.r), containing n arbitrary con¬ 
stants consists in (1) dividing the N observed pail's of x, y values into 
n approximately equal groups, choosing for each group only pairs that 
correspond to adjacent points when graphed; (2) averaging the x- and 
the ^/-values for each group separately to obtain n pairs of x, y values; 
(3) ‘with these average x, y values to describe selected points, using the 
selected-point method as described above. 

The results depend somewhat on the way the original N pairs of 
values are grouped and accordingly cannot be expected to yield the 
most precise results in the general case. This method does not require 
a graph and generally speaking is much shorter than most other methods. 
However, when one departs from the straight-line equation, for which 
it is particularly acceptable, it still serves well in giving a first approxi¬ 
mation which may be improved by further approximations. 

Let us apply the method to data (Table V), given by Osborne and 
Meyers 2 of the Bureau of Standards in an attempt to obtain an equa¬ 
tion for use in determining the boiling point of water as a function of 
barometric pressure. For this purpose only data in the neighborhood 
of the normal boiling point is needed. The successive-difference test 
shows that a three term equation of the type 

T = T 0 + a(p 0 - v) + ^(po ~ V) 2 [65J 


in which the subscript (0) refers to standard conditions, namely, 100° C 
and 760 mm-Hg, should suffice. Certain data as selected are shown 
grouped in columns two and three. The averages are shown in the 
next two columns. For carrying the work further, it is desirable to 
introduce new variables 

x = P - 720 m "T — [66] 

60 mm-Hg 


T - 98.486°C 
1 .000 C° 



1 Phil. Mag., VI, 39, 177 (1920). 

2 Osborne, N. S., and Meyers, C. H., J. Research \at. Bur. Staruiards, 13, 1 (1934). 
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TABLE V 

% 

Data Showing the Boiling Points of Pure Water for Various Pressures in 
the Neighborhood of Normal Atmospheric Pressure Given by Osborne and 
Meyer , 1 for Use in Illustrating the Method of Averages for Determining 

Equations 


Group No. 

BB 

T in °C 

Group p in mm-Hg 

Average T in °C 


800 

101.443 



1 

780 

100.729 

780 ‘ 

100.724 


760 

100.000 




740 

99.255 



2 

720 

98.492 

720 

98.486 


700 

97.712 




680 

96.914 



3 

660 

96.095 

660 

96.088 


640 

95.256 




In determinant form, the equation using x and y becomes 


y 

2.238 


x 


1 1 


-2.398 -1 1 


= 0 


[ 68 ] 


which simplifies to 

y = 2.318a: - 0.080a: 2 [69] 

and to 

T = 98.486° C - 0.03863 (p - 720 mm-Hg) 

mm-Hg 

- 0.0000222 —2 (p - 720 mm-Hg ) 2 [70] 

mm-Hg 


On transferring to standard conditions this becomes 


T = 99.995° C - 0.03686 -— (760 mm-Hg - p) 

mm-Hg * FJ 

- 0.0000222 - ^-—5 (760 mm-Hg - p ) 2 [71] 

mm-Hg J 


1 Idem. 
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Though the fit of this equation is not bad, it is quite inferior to that of 
the following equation determined by the selected points method. 

T = 100.000° C - 0.03682 C TT (760 mm-Hg - p) 

mm-Hg 


C° 

- 0.0000219 -—« (760 mm-Hg - p) 2 [72] 

(mm-Hg) ^ 


(e) Method of Moments. This method is sometimes used when the 
equation sought is of the form 

V — f(x) = a + hx + cx 2 -f • —b px q [73] 


The procedure requires that the ^-coordinates of the points to which the 
equation is to be fitted differ by a constant, A.r. If the original data do 
not satisfy this condition, it is necessary to plot the original data, fit a 
smooth curve, and choose from the curve a series of points with equi¬ 
distant abscissas. For such a set of points we define, in succession, the 
zero moment, y., the first moment, //> the second moment, y", etc., of 
y with respect to x as 

fj, = 'Ey Ax = Ax'Ly 

p! = 'ZxyAx = AxLxy [74] 

p" = 'Lx 2 yAx = AxXx 2 y, etc. 


It is then assumed that these moments are related to the desired curve 
as follows: 

r* 

H = I f(x)dx = AxZy 

xf(x)dx = A x'Zxy [75] 





A xXx 2 y, etc., 


where a represents the lowest ar-value less %Ax, and (3 the highest 
x-value plus Y^Ax. If the desired equation is linear in x, only the first 
two equations of Eqs. 75 are used; if of the second degree, the first three 
are used; etc. Substituting for f(x) its equal, Eq. 73, and integrating, 
we obtain for the linear case 





= AxZxy 
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The values of a and b may then be obtained by solving Eqs. 76 simul¬ 
taneously. 

Equations obtained by this method deviate from those obtained by 
more reliable methods, the more so the fewer the number of points. 
Its use is not recommended, since it is faulty in theory and usually 
entails more computational labor than far more reliable methods. 

6. Successive Approximations. For cases where the desired equation 
is, or can be made, linear with respect to its arbitrary constants, the 
results obtained using one of the methods above may generally be im¬ 
proved by taking successive approximations. Let the equation, trans¬ 
formed if necessary to a form linear with respect to the arbitrary con¬ 
stants or functions of them, be written 

y = a + bx + cx 2 H- [77] 

and let the values for the arbitrary constants and the computed y-values 
calculated as first approximations, using one of the above described 
methods, be represented by primes, a', b', y' c , etc. 

Ordinarily, in accord with a suggestion.made above, it will be advan¬ 
tageous to use rounded values for a', 6', etc., but not for the y' c ’s com¬ 
puted with their aid. So doing greatly reduces computational labor. 

The procedure for obtaining a second approximation follows: (1) Com¬ 
pute for the various given rr-values the corresponding values of y — y' c . 
(2) Plot (y — y'c ) as a function of x and fit, if possible, a smooth curve 
to the plotted points. Note that in this plot the distances of the points 
from the x-axis represent deviations of the first approximation equation 
from the observed data, and that the distances from the plotted points 
to the curve represent deviations of the observed data from the second 
approximation equation which is to be derived. (3) If a curve can be 
fitted, obtain its equation, either by the method used to obtain 
?/ = /(:r), or by any other suitable method. (4) Add this correction 
equation to the first approximation equation to obtain the second ap¬ 
proximation equation. 

If a third approximation is needed, steps 1 to 4 may be repeated. If 
necessary, still further approximations may be made until the best pos¬ 
sible fit is obtained. This condition is attained when the curve obtained 
by step 2 coincides with the .r-axis. 

On the other hand, the least-squares method may be used to obtain 
the second approximation equation. So obtained, it is identical with 
that obtained by least-squares treatment of the original data and cannot 
be further improved. This procedure, involving the obtaining of a first 
approximation by some simpler method as outlined above, which gen¬ 
erally lightens the computational labor connected with the method of 
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least squares, and increases greatly the ease of detection of computa¬ 
tional errors, is further explained in Chapter XI. 

At the close of the discussion of the selected-points method, it was 
indicated that the equation there derived to represent the data of Table 
IV, namely 

y = 1.377 e (0-5552* + 5.782* 2 ) [ 64 ] 

or in linear form for the undetermined constants, 

log y = 0.1388 + 0.241 lx + 2.511 lx 2 [63] 

could be bettered to overcome certain deficiencies in fit. With this pur¬ 
pose in mind, let us attempt improvement by successive approximations, 
using the selected-points method. 

That Eqs. 64 and 63 fail to a certain extent is indicated in the last- 
column of Table IV. To correct for the deviations shown, we seek an 
equation of the same form as Eq. 63 to represent (log y — log y' c ) as a 
function of x. One first plots, as in Fig. 1L4, (logy — log y' c ) = /(x). 
Then, selecting (0.3,-0.0052), (0.6,-0.0004), and (0.9,-0.0040) as 
probable points for the first approximation correction, one obtains for 
that correction 

A'(log y'c) = -0.0184 + 0.0580.x - 0.0467s 2 [78] 


Plotting next, as taken from the graph, the differences (log y — log y' c ) 
— A'(log y' c ) = /(x) gives the distribution shown in Fig. 11#. A second 
approximation correction seems desirable. Selecting the points 
(0.3,0.0006), (0.6,-0.0010), and (0.9,0.0006), the following second cor¬ 
rection equation is obtained: 

A" (log y'c) = 0.0054 - 0.0213x + 0.0178.x 2 [79] 


Plotting the new differences in 
third approximation correction. 


Fig. 11C, one sees the possibility for a 
For such correction, there is shown 


A'" (log y'c) = 0.0015 - 0.0025.x 



Whether or not this correction should be represented by a straight line, 
and if so, by the one indicated, is a matter of opinion. At any rate, that 
given can hardly be bettered with certainty without recourse to the 
least-squares method. 

Adding the three correction equations to Eq. 63 one obtains the 
fourth approximation 

log y"" c = 0.1273 4- 0.2753.x + 2.4822x 2 [81] 


and finally, writing y in place of y"" c 



1.3406c 


(0.G325J- 


-X 5.71701?; 
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The next question concerns the extent to which the computed con¬ 
stants are significant. Their probable errors (see Chapter VIII) can¬ 
not be determined, though, as will be shown in Chapter XI, probable 
errors can be determined for constants obtained by the least-squares 
method. Here we must be content with estimates. Inspection of Fig. 
11 C indicates that, at the most, reliance on computed values for logy 
to represent the measurements given in Table IV cannot exceed 0.0005. 
With log y varying from 0.12 for x = 0 to 2.7 for x = 1.0, this means 
for dy/y, the differential of log y, a variation from about 1/240 to about 
1/5000. It is therefore desirable to include in the way of significant 
digits in the computed constants of Eq. 81 only as many as will con¬ 
tribute l/5000th of the whole or more. For x = 1, where the value of 
log y is roughly 2.9, this means a A(log y) of 0.0006. To the extent of 
six in the ten thousandth place, it is to be seen that contributions are 
made by the last digits given in each of the computed constants, and 
that none could be made b}' additional digits had they been included. 
It follows that the computed constants for Eq. 81 are significant only 
to the extent shown. As to whether or not the coefficients of x and x 2 
in Eq. 82 should be rounded off to 0.632 and 5.717, the answer is difficult, 
since these are borderline cases. 

The rather irregular nature of the distribution of plotted points as 
shown in Fig. 11 was largely responsible for the need of the unusually 
large number of approximations made before the final equation was ob¬ 
tained in the case illustrated above. Often, particularly if the data are 
highly consistent, only one approximation correction is needed. Con¬ 
sider in this connection data by Regnault a* reported by Fowle. 1 (Table 
VI.) The equation to be fitted is based on the extremely important 
thermodynamic relation known as the Clapeyron equation 

l - r (Mh” - t83] 


of which L is a heat of transformation, c.g., vaporization, from phase 1 to 
phase 2, and T, p, and v are, in order, temperature, pressure, and specific 
volume. The data selected concern the saturated vapor pressure of 
CC1 4 . (See Table VI and Fig. 12.) From the plot of log p = /(1/T), 
the first approximation equation, that of a straight line in accord with 
thermodynamic reasoning, is readily obtained. V ith rounded values 


1 Fowle, F. E., Smithsonian Physical Tables, 7th 
Smithsonian Institution, Washington, D. C ., 1920. 


Rinsed Edition , p. 


173, The 
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TABLE VI 

The Saturated Vapor Pressure of Carbon Tetrachloride CCL for Various 
Temperatures as Determined by Regnault and Reported by Fowle , 1 and 
Certain Computations to Illustrate the Successive Approximation Method 

of Finding an Equation to Represent Given Data 


T in 
°C 

p in 

mm-IIg 

1 rr P 

T in 
°K 

1 . 1 

1600°K 

, n£ r P' 

10 5 log “ 
P 

t * r 

1 mm-IIg 

T K° 

T 

l°g 1 TJ 

1 mm-Hg 

55.0 

376.3 

2.57553 

328.16 

0.0030473 

4.87568 

2.57432 

121 

60.0 

447.4 

2.65070 

333.16 

.0030016 

4.80256 

2.64744 

326 

65.0 

528.7 

2.72321 

338.16 

.0029572 

4.73152 

2.71848 

473 

70.0 

621.1 

2.79316 

343.16 

.0029141 

4.66256 

2.78744 

572 

75.0 

725.7 

2.86076 

348.16 

.0028722 

4.59552 

2.85448 

628 

80.0 

843.3 

2.92598 

353.16 

.0028316 

4.53056 

2.91944 

654 

85.0 

975.1 

2.98905 

358.16 

.0027920 

4.46720 

2.98280 

625 

00.0 

1122.3 

3.05010 

363.16 

.0027536 

4.40576 

3.04424 

586 

95.0 

1286.9 

3.10955 

368.16 

.0027162 

4.34592 

3.10408 

547 


for the constants, and hence no expectation of a close fit, we use as such 
the straight line 


log- - - = 2.97 - 1000 °K (4 - 0.00280 A ) [84] 

1 mm-Hg \J Jv / 

Values for this function are given in the next to the last column of the 
table. In the last column, headed 10 5 log (p/p')> is shown the extent 
to which Eq. 84 fails to represent the data. These values are plotted 
in Fig. 12. The points shown as o are seen on the magnified scale, 
which may now be used, to lie on a smooth curve which seems slightly 
olT that for a second-degree parabola. Selection of a power series of the 

third degree in — 0.0028 and using positions where the curve, 

if drawn, would intersect the ordinates at 0.0027, 0.0028, 0.0029, and 
0.0030 lead to the correction equation 

log ^ = 635 X 10“ 5 
V 

(! y . - 0.0028 ^ - 125 X 10° K° 3 (y, - 0.0028 V) [85] 


4.75 K° 


(i-°- 


0028 


- 7.5 X 10 4 K° 2 


1 Idem. 
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That this correction equation has succeeded well is shown by the curve 
that has been drawn according to the equation. 



F.g. 12. A graph showing the saturated vapor pressure of CCI 4 as a function of 
temperature. The straight line represents a rounded first approximation. The 
points plotted as small circles represent the failure of that approximation. How 
well the second approximation accounts for the failure of the first is shown by the 
fit of the third-degree curve of Eq. 85 which has been drawn. 


Equation 85 added to Eq. 84 yields the relation desired, namely 


log 


V 


// 


— = 2.97635 - 1595.25 K° 

1 mm-Hg > 1 

- 7.5 X 15 K° 2 (’, - 0. 


a - * 


0028 



0028 



0 T'03 


- 125 X 10° Iv 


■ (i - 0. 


- 0.0028 



[80] 
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Differentiation of Eq. 86 and substitution in Eq. 83, once ( v 2 — t>i) is 
known, leads to a desired heat of vaporization. 

7. Summary. Data which yield a smooth curve on plotting may often 
be profitably represented by an equation. For the empirical case, the 
problem of fitting an equation to a set of data involves two steps: (1) 
finding a suitable form of equation to represent the data, and (2) obtain¬ 
ing suitable values for the arbitrary constants. For the rational case, 
the form of the equation is known from theoretical considerations, so 
that only step (2) is involved. 

For the empirical equation, there is no straightforward way of per¬ 
forming step (1); one can only guess at a suitable form from the shape 
of the curve representing the data. There are, though, methods of 
testing whether a particular guess is a good one. For most equations 
with only one or two arbitrary constants, a graphical test may be used; 
for equations with three or more arbitraiy constants, a tabular method 
(Table II) is often applicable. 

There are several methods for finding values for the arbitrary con¬ 
stants. The method of least squares (Chapter XI) is the most reliable, 
but generally the most laborious. Of the substitute methods, (1) the 
straight-line graph method may be used for most two-constant forms 
of equations as well as several three- and four-constant forms. It will 
generally give more accurate results with less labor than any other sub¬ 
stitute method for the two-constant forms for which it is applicable. 
(2) The method of selected points may be used for almost all forms of 
equations but is most suitable for linear forms or forms which can be 
made linear with respect to their arbitrary constants. This method is 
generally the most accurate for equations with three or more arbitrary 
constants, and is especially recommended when successive approxima¬ 
tions are to be made. (3) The method of averages, a special selected- 
points method, may be used only for equations which can be written in 
a form linear with respect to the arbitrary constants. For the straight 
line case it is highly precise. It does not require the construction of a 
graph. (4) The method of moments is applicable only to equations 
expressing y as a polynomial in x, and is considerably less reliable than 
any of the other methods discussed in this chapter. 

When fitting equations which are linear with respect to their arbitrary 
constants, the results obtained by applying one of the above methods 
may generally be improved by employing successive approximations. 
Generally also, the time involved may be shortened by following from 
the beginning the procedure of using for the first approximation only 
rounded values for the arbitrary constants. This method also provides 
a convenient way of simplifying the least-squares procedure. 
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PROBLEMS 

1. The ce-ray activity of a sample of radon, expressed in terms of its initial activity 
at the beginning of a test to determine its decay constant and half life, is found to 
have the following fractional values at the ends of succeeding 24-hour intervals: 
0.835, 0.695, 0.580, 0.485, 0.405, 0.335, 0.280, and 0.235. On the assumption that 
the activity obeys an exponential decay law, find the equation that represents the 
activity, and determine the decay constant and half life. 

2. Find a tabular suitability test for the equation 

ae~ bx 

y =- 

x 


3. Using the following data for the resistivity of tungsten as a function of tem¬ 
perature , 1 find the equation for p = f(T). 


T 

p 

T 

p 

°K 

p ohm cm 

°K 

p ohm cm 

1000 

25.70 

2500 

77.25 

1500 

41.85 

3000 

96.2 

2000 

59.10 

3500 

115.7 


The properties of many elements at elevated temperatures approximate (y/yo) = 
{T/To) a , hence try a ln-ln or a log-log relation. 

4. The emf of a standard Pt to (90% Pt—10% Rh) thermocouple 2 as a function 
of temperature when the cold junction is at 0.0° C is given as 


T 

E 

T 

E 

0°C 

0.000 mv 

1000 °C 

9.569 

200 

1.436 

1200 

11.924 

400 

3.250 

1400 

14.312 

600 

5.222 

1600 

16.674 

800 

7.330 




Apply the successive-differences test and determine how many terms in a power series 
in {T — 0° C) are needed to give a rather precise description of E = f(T - 0° C). 
Derive an equation of the form 

E — a(T — 0° C) + b(T - 0° C ) 2 + c(T - 0 ° C ) 3 

to represent the data given. Form a table showing, for the temperatures given, the 

differences between the given emf’s and your computed emf’s. 

6 . Using the data of Froblem 2, Chapter I, in which unsmoothed data were given 
for incandescent tungsten vacuum lamps relating percentage of normal voltage of 
operation to the temperature of the filament, compute a best curve of the type 

y j yr v £f( 1 + ft lOR T/T n ) 

Vn = V7V 


'Forsythe, W. E., and Worthing, A. G., Atrophy *. J 61, 153 (1925). 

2 ftoeaer, W. F., "Thermoelectric Thermometry." p. 194 of report of symposium on Temperature - 
Ha Measurement and Control in Science and Industry , New York, Reinhold Publishing Corporation. 


1041. 
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Use the method of successive approximations. Compare the results with those 
obtained by tabular smoothing. 

6 . As the result of a porous-plug test for air, Roebuck reports that air, started 
with the first pressure-temperature condition shown, will assume the succeeding 


conditions 

shown on 

passage through a 

succession of 

porous plugs properly con- 

trolled. 

P 

T 

V 

T 


215.8 A 

0 .00°C 

12S.1 A 

—10.80° C 


180.9 

-3.35 

109.7 

-14.02 


108.4 

-4.(53 

91.2 

-17.69 


154.4 

— 6.51 

73.5 

-21.56 


140.7 

-8.67 




Find the best power series, using successive approximations, for representing these 
data. 

7. Graph carefully the data in the first and third columns of Table IV, p. 257, 
and, with the aid of Eqs. 52 to 55, determine the constants for an equation of the 
form y = a sin M + 4>) to represent the data. Compare your result with the least- 
squares result at the bottom of the table. 

8 . With the result obtained in the previous problem as a first approximation, 
obtain a second approximation. 

9. Derive the criterion of tabular suitability for Eq. 10 of Table II. 

10. The reflectance // of a certain porcelain enamel as a function of opacifier con¬ 
tent x, arbitrarily defined, as given by H. C. Arnold, is 


X 

1/ in % 

•T 

V in % 

X 

V in % 

0.0 

63.00 

3.0 

68.30 

6.0 

70.60 

0.5 

64.30 

3.5 

68.80 

6.5 

70. SO 

1 .0 

65.35 

4.0 

69.30 

7.0 

70.90 

1.5 

66.15 

4.5 

69.65 

7.5 

71.00 

2.0 

67.00 

5.0 

70.05 

8.0 

71.05 

2.5 

67.70 

5.5 

70.30 



1)1 ain an equation with not 

more than three parameters 

to represent the data. 

11. Obtain an 

equation of 

the form P 

i = f(t) for the following tabulated values 

aphed in Fig. 4, 

, p. 175. 





t 

r, 

t 

Pt 

t 

Pt 

sec 

sec -1 

sec 

sec -1 

sec 

sec -1 

0.25 

0.708 

2.75 

0.070 

5.25 

0.008 

0.75 

.450 

3.25 

.055 

5.75 

.013 

1.25 

. 284 

3.75 

.035 

6.25 

.005 

1.75 

. 192 

4.25 

.024 



2.25 

.138 

4.75 

.018 
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CHAPTER IV 


TABULAR AND GRAPHICAL DIFFERENTIATION 

AND INTEGRATION 


1. Introduction. The solutions of many problems include finding the 
slope of a curve or the area of a closed figure. Of such great importance 
have these processes been historically that their solutions lead directly 
to the invention of the calculus. Mathematically the derivative, dy/dx , 

of a function, y = f(x), and the definite integral, / y dx, are involved. 

j X\ 

The function/(x) is often known explicitly. Here, however, we are con¬ 
cerned principally with those that are not known. 

The derivative problem has already been encountered in Chapter 
III, where the slope of a straight line was required for the evaluation of 
one of the constants of an empirical equation. More often the slope 
itself is desired because of what it itself represents. 

Often, slopes that are desired are those of nonlinear curves as (1) in 
the field of chemical thermodynamics, where values of dE/dT are sought 
in order that we may obtain heats of reactions which proceed in voltaic 
cells, in accord with the Gibbs-Helmholtz equation, 

au--q(e-t§) [1] 

of which A U is the change of internal energy, Q the quantity of elec¬ 
tricity transferred, E the emf of the cell, and T the absolute temperature; 
(2) in the field of electrical engineering, when the power loss, P, of a 
motor or generator is obtained by the retardation method, and values 
of doj/dt are needed for use with the equation 



of which I is the moment of inertia of the rotor, o) its angular velocity, 
and cUa/dt its angular acceleration; and (3) in the field of heat measure¬ 
ments, when the conductivity, k, of a metal in rod form is measured by 




86 


DIFFERENTIATION AND INTEGRATION 


the Biot, Wiedemann, and Franz method. Here the equation used is 


k = 


dQ 

dt 


~(dT\ / 

\dl )i~ \ 


dT 
dl) 2 


[3] 


of which dQ/dt is the rate of transfer of heat, dT/dl temperature gradient, 
and A cross-sectional area. 

Problems involving integrations are equally important and numerous. 
Typical examples occur (1) in the field of mechanical engineering, when 
the mean effective pressure in the cylinder of a steam engine is obtained 
from the area of an “indicator diagram” showing the pressure as a 
function of the position of the piston; (2) in the field of chemical ther¬ 
modynamics, when the absolute entropy, S, of a pure substance at the 
absolute temperature, T, is calculated, using the defining equation 






of which c p represents a specific heat and L a heat,of transformation; and 
(3) in the field of electrical measurements, when the hysteresis energy 
loss per unit volume, IF, for a magnetic material is obtained from the 
area of its “hysteresis loop,” using 


W 


-rj 


HdB 


[5] 


of which H represents magnetic field strength and B magnetic induction. 

There are numerous methods of solving both the slope and the area 
problem. Which method is best depends on the nature of the problem 
and the form in which the data are presented. If the data are available 
in equation form as y = f(x), the derived equation, (dy/dx) = }'(x), or 


/ 


mathematical differentiation or integration. Particular values of dy/dx 

for any value of x, or of J y dx for any set of limits, can then usually 

be obtained with ease and with precision. When the data are presented 

in tabular or graphical form there are two possibilities. It may be best, 

and particularly is this so when a general expression for dy/dx or 
» 

y dx is desired, to find y = f(x ) empirically by the methods covered 
in Chapter III, and then to differentiate or to integrate mathematicall^^ 
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However-, if only a few particular values of dy/dx or of J y dx are 

wanted, or if the equation y = }{x) is too complicated, one of the 
graphical or tabular methods to be described may be preferable. 

2. Graphical Methods of Finding dy/dx. (a) Tangent and Normal 
Methods. The procedure for the graphical determination of the slope 
of a curve at a particular point, that corresponding to x say, consists 
of three steps: (1) plotting with considerable care the curve y = /(x), 
(2) locating the line tangent (or normal) to the curve at x, and (3) cal¬ 
culating the slope of the curve. For the tangent 

dy = y 2 ~ Vi 
dx x 2 — x\ 

where (x u yi) and (£ 2 , 2 / 2 ) are two conveniently chosen points on the 
tangent (or normal) line. 

Seemingly slight variations in the curve representing y = f(x) may 
result in large variations in dy/dx. For this reason it is important that, 
in step 1, one should follow with care the rules of good practice stated in 
Chapter II. It is especially desirable to have the tangent line at x in¬ 
clined at about 45° to the x-axis. Also for greatest accuracy and con¬ 
venience, the points chosen for step 3 should be as far apart as is prac¬ 
ticable and should be intersections of the tangent (or normal) with main 
coordinate lines. 

There are several methods of performing step 2. The simplest method 
of locating the tangent line at x is that of slowly rotating a straight edge 
on the convex side of the curve about the point until it seems to be tan¬ 
gent to the curve. Much depends on good illumination. With prac¬ 
tice, rather accurate results may be obtained by this method. Per¬ 
formance is improved by the use of a transparent rule with a long nar¬ 
row scratch or cut on its under side. 

Some workers prefer to determine the dy/dx of a given curve by the 
indirect method, which involves first determining the normal. This 
method requires distinguishing between the geometric slope of a curve 
at a particular point and its physical slope. The former for the common 
plot oi y = /(x) at a particular point is the tangent of the angle which 
the tangent to the curve at that point makes with the x-axis. For a given 
function and a particular x, the value of the geometric slope varies with 
the scale choice. Its unit is the numeric one. The physical slope for a 
particular x, however, does not change with the scale choice. Its value 
is dy/dx. Its unit is that of y divided by that of x as, for example, 
cm/sec, K°/cm, etc. 
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With subscripts gc and gn referring to the geometric slopes of a curve 
and its normal, we may write 



correspondingly with subscripts pc and pn referring to the physical slopes 
of the curve and its normal, we may write 



Here (by/Sx), a scale factor for the graph, is the ratio of a physical by cor¬ 
responding to a length measured along the y -axis to the physical bx cor¬ 
responding to the same length measured along the x-axis. As is apparent, 



Fig. 1 . The Simons tangent meter. Parts A, A are lucite blocks. B is a first sur¬ 
face metal mirror. C, C are brass binding strips. D, D are machine screws. E is 
an index line perpendicular to mirror B scribed on the bottom of the lucite blocks. 


the introduction of the scale factor makes it possible for the equation to 
check dimensionally. Proof of Eq. 7 a is left for a problem at the end of 
the chapter. 

Given Eq. 7a, the procedure for determining a physical slope follows. 
One first finds the position of the normal. A satisfactory method for 
doing this consists of placing a long narrow piece of plane, first-surface 
mirror across the curve, rotating it until the curve and its reflection in 
the mirror form a smooth curve as shown by the “squint test” (Chapter 
II). The plane of the mirror is then normal to the curve. Though a 
short mirror may be used, a long one is preferred in order that the cal¬ 
culation of its slope may be as accurate as possible. Next, one deter¬ 
mines the scale factor in accord with the definition given above and then 
finally the physical slope, using Eq. la. 
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A convenient apparatus, which employs the normal principle yet per¬ 
mits of the direct determination of the physical tangent from the graph, 
is the tangentmeter (Fig. 1) described by Simons. 1 The polished, plane, 
first-surface, metal mirror mounted between the lucite blocks is first set 
normal to the curve. The scratch perpendicular to the mirror is then 
parallel to the desired tangent and permits determining dy/dx at once. 

In Chapter III it was noted that, if a graph of y = f{x) is to be used 
for determining the derivative dy/dx, one should select scales for plot¬ 
ting which give an approximate geometric slope of unity. We can now 
< 



Fig. 2. A graph showing that greater precision for determining a dy/dx is possible 
when the geometric slope is approximately unity than when it deviates considerably 

from this value. 

show why this is the case. Consider the determination of the dy/dx 1 s 
at p and q, corresponding points on the two curves of Fig. 2 with geo¬ 
metric slopes of approximately 1 and using the normal method. 
Obviously their relative accuracies will depend on the accuracies with 
which the geometric slopes of the normals may be obtained, and these 
in turn on the accuracies with which the lengths ac, be, df, and ef may 
be determined. Given that ab and de are of equal lengths and that the 
uncertainty in the other linear measurements is a certain small amount, 
say 0.2 mm, it is obvious that the relative accuracies of the two dy/dx 1 s 
will depend most of all on the relative accuracies of the measurements 

« Simons, H. P., Irul. Eng. Chetn. (Anal. Ed.), 13, 563 (1941). See also LatLshaw, 
J. J., Am. Chem. Soc., 47, 793 (1925). Richards and Raspe, Science, 71, 290 (1930). 
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of ac and df and that the accuracy for the determination of dy/dx at p 
is greater than at q. Just how much greater will depend on principles 
to be discussed later in Chapter IX. 

(b) Secant Method. For a possibly greater accuracy than that yielded 
by the tangent or the normal methods, the secant method may be used. 
In this instance the slope of the tangent line is obtained as the limiting 
position of the secant line drawn through ( x,y) and nearby points P lf 
P 2 , etc., as P approaches x. For this purpose, four or five or more posi¬ 
tions of P are chosen. It is convenient to let the values A\X, A 2 x, A s x , 
etc., representing changes in x in passing from ( x,y ) to points P u P 2 , 
etc., be multiples of a chosen Ax. Let the corresponding changes in y 
be A x y, A 2 y, etc. The quotients A x y/AiX, A 2 y/A 2 x f etc., representing 
slopes of secants passing through the point (x,y), are then plotted as a 
function of x or of A.r, and a curve giving Ay/Ax = /( Ax) is drawn. 
The value of Ay/Ax for Ax = 0 is, of course, the dy/dx desired. With 
values tor x and y taken from a suitable table, the only graphing that 
may need to be performed is that showing Ay/Ax = f{x). The points 
P\y P 2 > etc., need not all be on the same side of the point ( x,y ). 

Illustrating the secant method, consider the data of Table I showing 
the pyrometer current, I P) of a certain disappearing filament optical 

TABLE I 

The Pyrometer Current, I ,„ of a Certain Disappearing Filament Pyrometer 
for Disappearance Against a Background at Various Spectral Bright¬ 
nesses, B\ (X = 0 . 665 m ), Expressed in Terms of 0 Bx for a Black Body at the 

Gold Point, 1336° K 


Bx 

oBx 

I p in ma 

. B * 

log „ 

o»x 

l»g i P 

log Ip- log /po 

A log I P 

, B x 

A log — 

0D\ 

0.125 

193.8 

-0.9031 

2.2873 

-0.1141 

0.1263 

0.250 

210.8 

-0.6021 

2.3238 

- .0776 

.1288 

0.500 

230.1 

-0.3010 

2.3619 

- .0395 

.1312 

1.000 

252.0 

0.0000 

2.4014 

.0000 

• • • • 

2.000 

277.1 

0.3010 

2.4426 

.0412 

.1369 

4.000 

305.8 

0.6021 

2.4854 

.0840 

.1395 

8.000 

338.5 

0.9031 

2.5296 

.1282 

.1420 

16.000 

370.0 

1.2041 

2.5752 

.1738 

.1444 

32.000 

419.5 

1.5052 

2.6227 

.2213 

.1470 

64.000 

470.2 

1.8062 

2.6723 

.2709 

.1500 
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pyrometer as a function of the spectral brightness, B\, of a source of 
light. Let us find (B\/I p ) ( dlp/dBJ for the pyrometer lamp when 
matching a black body background at the gold point. The quantity 
sought is the slope of the curve log I p = /[log (B\/oB\)] at log (B\/ 0 B\) 
= 0 . 

Computed values for A log 7 P /A log (£x/o£x) are included in Table I. 
These values are graphed in Fig. 3. For log ( B\ /o-^x) = 0.000 the slope 



Fig. 3. Illustrating, with the aid of the data of Table I, the secant method for the 
precise determination of a slope. The slope sought is that of (B\/I p )(dI p /dB\) 
for log (B\/oB\) = 0.000. 

is seen to be 0.1341. Generally the inverse of (B^/I p )(dI p /dB x ) is de¬ 
sired. This inverse value is 7.45, and states that for a black body at 
the gold point the spectral brightness at X = 0.665 m varies 7.45% for a 
1.00% variation in the matching pyrometer current. The work required 
is considerable in comparison with that required by the tangent oi the 

normal method. 

There are mechanical devices for evaluating dy/dx from a plot of 
y = j(x) 1 and other devices which automatically draw out the curve of 
dy/dx = f'(x) when their tracer arms are made to follow the y = f(x) 
curve in a particular manner. 2 Such instruments are rather compli- 

1 Evans, D. L. C., Engineering, 144, Sept. 3, 1937. 

* Lipka, J., Graphical and Mechanical Computation, p. 255, New York, John Wiley 
& Sons, 1918. 
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cated to use, however. They yield no increase in accuracy, but are very 

valuable as time savers in certain specialized routine problems. 

3. Tabular Methods of Finding dy/dx. When the tabulations are 

precise, these methods equal, or are superior to, graphical methods in 

accuracy, and permit the calculation of derivatives of the second and 

higher orders directly from the original data. The necessary equations 

are obtained by differentiating the interpolation formulas of Chapter I. 

Thus, the Gregory-Newton formula (Eq. 7 of Chapter I) expresses 

V ~ /(- r ) i n terms of the successive differences of y obtained from a 
table of y = f(x) as 

, , n(n — 1) 0 

V — y o 4- nAy 0 4 — A“y 0 4~ • • • [8] 


Here (.ro>2/o) is a tabulated point near ( x,y ), Ax is the constant tabular 
2 -interval, and n is defined by 



I he terms A// 0 , A 2 yo, etc., are the first, second, etc., order of differences 
of the tabulated y’s (see Chapter I). There follows 


Hence, 

dy 

dx 


dy 

dx 


1 

Ax 




Ay {) -f (2 n - 1) 


+ (3 n 2 - Cm -f 2) 





+ (4 n 3 - 18/i 2 + 22/i - 0) H- j [11] 

With Ax negative and x < 2 * 0 , one uses an upward slanting set of A’s 
(see Table II) of which the signs of the Ay, A 3 //, A 5 //, etc., differences 

" ill 1 )0 changed, but the signs of the A 2 //, A 4 ;/, etc., differences will be 
unchanged. 

An example illustrating the method follows. 

Example, hrom the values for y = f(x) = log x, given in Table II> 
find dy/dx for 2 * = 1.726. 
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TABLE II 


Showing Several Values for y — f(x) = Log x for a Limited Range of x and 

Their Successive Differences Ay, A 2 y, Etc. 


X 

y 

Ay 

A 2 y 

A*y 

A 4 y 

A 6 y 

1.0 

0.00000 

0.17609 





1.5 

.17609 

.12494 

-0.05115 

0.02312 



2.0 

.30103 

.09691 

- .02803 

.01030 

-0.01282 

0.00802 

2.5 

.39794 

.07918 

- .01773 

.00550 

- .00480 

.00257 

3.0 

.47712 

.06695 

- .01223 

.00327 

- .00223 

.00108 

3.5 

.54407 

.05799 

- .00896 

.00212 

- .00115 


4.0 

.60206 

.05115 

- .00684 




4.5 

.65321 






5.0 

.69897 







As x 0 we select 1.500 and as Ax, 0.500. There follows from Eq. 9 



1.726 - 1.500 
0.500 


0.452 


Substituting into Eq. 11, yields 


(~) = —!— [0.12494 

\dx/ 1.720 0.500 L 


+ (2 X 0.452 - 1) 


0.02803 


„ _ 0.01030 

+ (3 X 0.452 2 - 6 X 0.452 + 2)--- + 

u 


= 2.000(0.12494 + 0.00135 - 0.00017 - 0.00014 • • ■) 
The final result depends on the number of terms included: 


Number of Terms 

dy 

dx 

Correction 

1 

0.24988 

+0.00174 

2 

.25258 

- .00096 

3 

.25224 

- .00062 

4 

.25196 

- .00034 
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4. Tabular Methods of Finding J y dx. There is a wide choice of 

tabular methods for finding areas and the final equations—the so-called 
quadrature formulas. To data in graph form, they may be applied 
with the same ease that attends their application to tabulated data. 
In fact, their significance and use are best shown graphically. 

C Zp 

(a) Trapezoidal Rule. The value of the integral / y dx which we 

J X\ 

seek is represented in Fig. 4 by the area X\APxpX\. Except for a re¬ 
mainder x p — x n in width, let this area be subdivided, as shown, into 



x 

Fia. 4. Illustrating the derivation of the trapezoidal rule and of Simpson’s A rule. 

(n-1) strips of equal and convenient width, Ax, by ordinates at X\ y 
x 2 , • • • x n . The approximation is made such that between two suc¬ 
cessive intersections of the curve with the ordinates, such as the points 
A and B, the curve may be replaced by a straight line without appre¬ 
ciably changing the area of the strip. Hence, by the trapezoidal rule, 
the area of the strip x\ABx 2 x\ is taken as A.r(?/i -j- y 2 )/2, and the area 
under the curve as the sum of the areas of (n — 1) such strips, plus the 
remainder of width x n x p , or 

dx = Ax + y 2 + y 3 H-f y n _ x 

+ (Xp - Xn ) [14] 

It is apparent that the smaller the value of the interval Ax, the closer 
the value given by the rule approaches the true value of the integral. 
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As Ax decreases, however, the number of ordinates to be added together 
increases, so that unless an adding machine is available, the work be¬ 
comes more tedious and chances for error increase. When the data are 
given in tabular form, Ax cannot be taken smaller than the ^-interval 
of the table, so that one of the other formulas must be used if an approxi¬ 
mation better than that given by the trapezoidal rule is desired. 

(b) Simpson's Y Rule. Let the area desired be subdivided, except 
possibly for a remainder at one end whose area, s r , may be found other¬ 
wise, into an even number of strips of equal width, Ax , by ordinates at 
Xi, x 2 • • • x„, as in Fig. 4. The assumption is then made that between 
points A and C the curve may be replaced by a parabola of the second 
degree passing through points A, B, and C without changing appreciably 
the area of the two strips underneath. On the basis of this assumption, 
it can be shown that the area of these two strips is Ax(t/i + 4 y 2 4- ?/3)/3. 
Hence, by Simpson’s Y rule the desired area is the sum of (n — l)/2 
such double-strip areas, or 



Ax 


Ax 


(2/1 4- *b/ 2 4- 2 y-i + 4 2/4 -j— -4- 4«/ n _i 4- y n ) 4- s r 


[(2/i 4- y n ) 4- 2(</3 4- 2/5 4-) 4- 4 ( y 2 4- y \ 4- • • •)] 

4" i (*p - x n )( y n 4- y P ) [15] 


Simpson’s Y rule will usually, but not always, yield a closer approxi¬ 
mation to the actual area sought than will the trapezoidal rule using the 
same Ax. When the data for the interval over which the integral is to 
be taken are given an odd number of strips, Simpson’s rule may be 
used for all but the last strip, whose area may then be combined with 
that represented by s r and calculated by the trapezoidal rule. 

(c) Simpson's % Rule. By reasoning similar to that for the H rule, 
it can be shown, if the area under the curve y — /(x) is assumed sub¬ 
divided into (n — 1) strips of equal width, Ax, where (/i — 1) is now 
divisible by three, and it is further assumed that the curve above any 
three adjacent strips approximates a third degree parabola, that the 
formula known as Simpson’s % rule becomes applicable. In algebraic 
form it states 



3Ax 

8 


[(2/1 4- y n ) 4- 2(2/4 4-2/7 4- 2/10 4-) 

4- 3(2/2 4- 2/3 4- 2/5 4- 2/6 4- 



For a given value of Ax, Simpson’s % rule will usually, but not always, 
give a closer approximation than Simpson’s }/$ rule. 
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(i d ) Weddle's Rule. By subdividing the desired area into a number o{ 
strips divisible by some integer m, and approximating the curve above 
m such adjacent strips by an mth degree parabola, it is possible to ap¬ 
proximate curve boundaries more closely than is possible with the sim¬ 
pler trapezoidal and Simpson’s rules. One such procedure known as 
Weddle’s rule is obtained by simplifying somewhat the general formula 
for m = 6. It states that 

[(2/i + Vn) + 5(?/2 + 2/6 + 2/s + 2/12 + 2/14 H-) 

+ (2/3 + 2/5 -f 2/9 4- 2/11 + 2/15 H-) 

+ 6(7/4 + 2/10 4- 2/i6 H-) 

+ 2(7/7 + 2/13 + 2/i9 H— *)] [17] 

chances for error in using this equation are evident, 
the use of this rule rather than one of the simpler rules. 
Example. Let us consider the results which these va- 
formulas yield when applied to a particular case. For 
this we choose theoretically computed values for spectral black body 
radiancy, d? x , at any given temperature, expressed in terms of the maxi¬ 
mum, (R\ maxi as a function of the product of wave length and tempera¬ 
ture XT. The values of (R\/(H X max for various XT values as given by 
Lowan and Blanch 1 are given in Table III. 

TABLE III 

Showing (R\/(R \max for Black Body Radiation as a Function of \T 


\T in cm K° 


0.08 

.10 

.12 

.14 

.10 

.18 

.20 


t ffx 

XT in cm K° 

(fix 

(R\ max 

(fix inax 

0.0014 

0.22 

0.8188 

.0107 

.24 

.9139 

.0735 

.20 

.9719 

.1880 

.28 

.9974 

.3470 

.30 

. .9908 

.5230 

.32 

.9705 

.6800 





Zn 7 3 Ax 

ydx = IF 


The increased 
Few cases justify 
(e) Illustrative 
rious quadrature 


1 Lowan, A. N., and Blanch, G., J. Optical Soc. Am., 30, 70 (1940). 
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For the average ^xMmax for the range 0.08 cm K° < \T < 0.32 
cm K° as expressed by 


Average 


(R 


1 


.32 cm K° 


(R 


X max 


0.24 cm K 



(R 


(R 


d(\T) [18] 


X max 


the trapezoidal rule, the Simpson rule, the Simpson % rule, and the 
Weddle rule in order yield 0.5852, 0.5854, 0.5853, and 0.5855, all of which 
are close to the value 0.5854 which is yielded by more precise calcula¬ 
tions using smaller intervals. That the trapezoidal rule should have devi¬ 
ated most from the true average is to be expected, but that the Simpson 



Fig. 5. To find the area of A BCD, the lengths y 2 , yz • • • may be subst itut ed into any 

quadrature formula. 

Y rule should have come closest is hardly to be expected. 4 he com¬ 
parison supports the fact that often, and especially where Ax is small, 
the simple trapezoidal rule will frequently yield results as accurate as 
the data justify. Only rarely is it necessary—and hence desirable—to 
use any formula beyond the easily remembered Simpson’s Y rule. This 
conclusion is commensurate with that reached in Chapter III, where it 
was found that short portions of most curves can be represented em¬ 
pirically by second-degree parabolas. 

When the area of an irregular closed figure such as that of Fig. 5 is 
to be measured by one of the quadrature formulas, we may divide the 
figure into the proper number of strips by the parallel equidistant lines 
at x lf x 2 , • • • x n , and then substitute the lengths of these lines into the 
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formula used. This procedure is equivalent to subtracting the area 
X\ADCx n Xi from the area X\ABCx n Xi. 

5. Graphical Methods of Finding J~y dx. (a) Polar Planimeter 

Method. There are many mechanical devices for measuring areas. Most 
of them, provided the data are once satisfactorily graphed, are more 
rapid than using quadrature rules. Further, they are sometimes more 
accurate, especially so when the desired area has very irregular bound¬ 
aries. The instruments range from the extremely simple hatchet plani¬ 
meter 1 to such complex mechanisms as that which automatically inte¬ 
grates the product of two empirical functions in a few seconds. 2 Be¬ 
tween these extremes, the polar planimeter is probably the most suitable 

Q 


P 

Fig. 0. A diagram showing the main characteristics of the polar planimeter. OQ 
represents the pivot arm pivoted at O, QP the tracer arm with tracer point at P, 
and W the recording wheel. 

compromise with regard to simplicity, applicability, cost, availability, 
and accuracy. There are several forms of polar planimeters, differing in 
minor details of construction and refinement, but the essential parts of 
the instrument (Fig. 6) are (1) the polar arm, OQ, with a point 0 which 
is maintained fixed during an operation; (2) the tracer arm, QP, adjust¬ 
able usually as to length, which is hinged to the polar arm at Q and 
terminates at one end in a tracer point P; and (3) the recording wheel, W. 

To measure an area with the polar planimeter, the following steps are 
performed: 

1. Locate the fixed point, 0, so that in tracing the figure, the wheel, 
W, does not go off the edge of the paper, or over any folds or other 
irregularities; the more uniform the surface on which the wheel rolls, 
the greater the possible accuracy of the measurement. 

2. Place the tracer point, P, on the perimeter of the area, noting 
the reading of the recording mechanism attached to the integrating 
wheel. 

1 Haynes, F. B., and Haynes, I. C., Rev. Sci. Instruments, 2, 396 (1931). 

2 Sears, F. W., J. Optical Soc. Am., 29, 77 (1939). 
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3. Trace the boundary of the figure carefully until the starting 
point is reached once more (this is important), and note the new read¬ 
ing of the recording mechanism. 

4. Subtract the two readings to obtain the number of rotations of 
the wheel. 

5. Multiply the number of rotations so obtained by the calibration 
constant to obtain the area measured. This constant may be calcu¬ 
lated from the dimensions of the instrument by Eq. 19 below, or it 
may be found by noting the number of rotations produced in tracing 
a figure of known area, such as a triangle or a rectangle. 

More reliable values for areas using a polar planimeter are obtained 
if the figure is traced a number of times—five say. It may also help to 
trace the figure five more times in a direction opposite to the first, and 
to average the results thus obtained. If proper precautions as to their 
locations are taken, a straight edge or a transparent drawing curve that 
coincides with the boundary of the figure measured for a reasonable 
distance may be used as a guide for the tracer arm point. Other sug¬ 
gestions concerning the use and care of the polar planimeter may be 

found elsewhere. 

That the number of rotations of the integrating wheel is directly pro¬ 
portional to the area traced is easily shown. Consider the three move¬ 
ments for the tracer arm shown at A, B, and C, Fig. 7. In A, the arm 



Fio. 7. Diagrams showing areas swept out by the tracer arm of a polar planimeter 

during each of the three possible elementary motions. 


moves a distance ds at right angles to its length, l. Ihe area swept 
out is Ids; and, if r represents the radius of the integrating wheel, the 
angle through which the wheel rotates is dd (= ds/r). In B, the arm 
moves parallel to itself. The area swept out is zero; so also is the angle 
through which the wheel rotates. In C, the arm rotates about a fixed 
end. The area swept out is y 2 Pda; the angle dcf> through which the in¬ 
tegrating wheel rotates depends on its position with respect to the fixed 
end. In any case it is proportional to da and may be written as c da. 

All motions, no matter how complicated, that are possible for the 
tracer arm of a polar planimeter as used (Fig. 8), may be viewed as a 
combination of infinitesimal motions similar to those of A, B , and C of 
Fig. 7. If, for such a motion, we add the condition that at the end of 
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the movement the tracer arm shall occupy its intitial position, we have 
the result, taking account of the vector nature of 0, that the sum of the 
d0’s, all of which have taken place about the Q end of the arm, is zero. 
In actual instruments this condition is assured by having end 0 (Fig. 6) 
of the polar arm fixed so that the Q end of the tracer arm is limited to the 
arc of a circle. It follows, when an area is traced, that the integrating 



Fig. 8. A diagram showing several successive positions of the tracer arm of a polar 
planimeter when, with the fixed point of the polar arm at O, the tracer point is 
moved around the area abcdefga. During this movement, the whole of the enclosed 
area is swept out by the tracer arm in the same direction, namely, counterclockwise, 
and only once. The cross-hatched area, however, is swept out twice, once clock¬ 
wise and once counterclockwise. 

wheel will show only the vector sum of a number of dO' s. We see at 
once that the area A is given by 

A = ZdA = Ir'Ldd = IrB [19] 

In actual use, it is customary, though not necessary, to move the tracer 
point counterclockwise about the area to be measured, and to reckon 
as positive an area that is swept out by counterclockwise rotation of 
the tracer arm about the end which is limited in motion to the arc of a 
circle. 

It is interesting to follow through the motions of the tracer arm in 
Fig. 8, and to see what area has been measured. Let abcdefga be the 
area traced out by tracer point P. As the tracer arm takes the suc¬ 
cessive positions aa\ bb\ cc', etc., back to aa\ the*area that is cross- 
hatched is swept over first clockwise and then counterclockwise. In 
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the summation of dA’s this area yields zero. Only the area abcdefga is 
swept once, and all in the same direction. Hence the A of Eq. 19 refers 
to this area only. In certain irregular areas, portions of the enclosed 
area to be measured may be swept out three times, or five times, or 
some odd number of times, but never an even number of times. More¬ 
over, the net effect of the sweepings in excess of one for these portions 
are always in directions such as to annul one another in pairs. In 
effect, even in these very irregular areas, the tracer arm sweeps the 
enclosed area only once, and all in the same direction. 

A slight difficulty arises in the use of a polar planimeter when, in 
sweeping out the area with the tracer point P, the point Q at the junc¬ 
tion of the two arms describes a complete circle about the fixed point 0. 
When QP is less than OP and for most other cases, area A is then given by 

A = IrQ + n(R 2 + l 2 ) [20] 


of which R is the length of polar arm OQ, and d the angle through which 


the recording wheel turns in consequence of motions described in Fig. 


7A only. It is not the total angle through which the wheel has turned. 
It is that angle less the angle (f> which corresponds to « = 2?r radians. 

(6) Average Ordinate Method. This method, like the polar planimeter 
method, requires that the data be graphed. It is not suitable for the deter¬ 
mination of all areas. Practically it is limited to cases where the whole 
area can be broken up into several parallel-sided approximations to trap¬ 
ezoids such as were assumed for the various above-listed tabular methods 


for finding J ydx. For such cases, it combines with high accuracy the 

simplicity of the inaccurate counting squares procedure. 

The method can best be described in connection with an application. 
Fig. 9 shows a temperature-time curve for a standard compensated-loss 
calorimeter such as might be obtained when, with its aid, one seeks to 
determine the amount of heat lost by a heated specimen of material on 
cooling from some high temperature to that of the calorimeter. The 
fore interval is the period previous to the receipt of the heated specimen 
and during which stirring of the calorimetric fluid is principally respon¬ 
sible for the change of temperature. 1 he test interval is the period 
during which heat is transferred to the fluid by the heated specimen and 
a near equilibrium of temperature is being established. The after inter¬ 
val is the final period during which temperature variations are a com¬ 
bined result of stirring and of Newtonian leakage. One seeks the tem¬ 
perature interval T c - T b . This involves finding the area b'bdd'b'. 

The approximations to trapezoids which we will use here are those 
determined by the 0C° line, the temperature-time curve, and the ordi- 
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nates at 4, 6, 8, 10, 12, and 14 min. We first locate a straight edge so 
that it passes through the intersections of the 4-min and the 6-min 
ordinates with the temperature-time curve. Then on the 5-min line 
we locate the point m which is two-thirds of the way from the straight 
edge to the curve. Insofar as Simpson’s rule is applicable, m'm is 
the average ordinate for the area between the 4-min and the 6-min 
ordinates. Next in order points n, o, p, and q are located similarly, and 
similarly they represent the upper limits of other average ordinates. 



Fig. 9. The temperature-time curve for a standard, compensated loss calorimeter to 

which a heated specimen of material has been transferred. 

The upper limit of the average ordinate for the area between the 4-min 
and the 8-min ordinates is now determined. It is the point r on the 
middle or 6-min line where that ordinate is cut by a straight line between 
m and n. Similarly s is the upper limit of the average ordinate for the 
area between the 8-min and the 12-min lines. On the same basis, posi¬ 
tion t on the 8-min ordinate is the upper limit for the average ordinate 
for the area between the 4-min and the 12-min lines. The area between 
the 12-min and the 14-min lines may be similarly combined with the 
area associated with point /. Since, however, the time width of this 
area is only one-fifth that of the combined areas, one must select, on the 
straight line passing through t and q, a point u which is but one-fifth of 
the way from t to q. Accordingly the ordinate u'u is the average ordi¬ 
nate for the area between the 4-min and the 14-min ordinates and the 
area sought is 422 min C°. How this may be used in determining 
T c — T b will be found elsewhere. 
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Depending on the scale and the care used, this method is susceptible 
of high precision. If the data are available in the form of an acceptable 
curve rather than in a tabulation of ^/-values for equal .T-intervals, this 
method might well be superior to all other methods, particularly if 


time is a factor. 

(c) Cut-cmd-Weigh Method. If the figure whose area is desired is cut out 
and weighed, its area can be found by dividing its weight by the weight 


per unit area of the paper on which 
it is drawn. Obviously this pro¬ 
cedure would make the figure unfit 
for any further use, so that in prac¬ 
tice the outline of the figure is traced 
onto a second sheet, preferably of 
heavy paper or metal foil, which is 
then cut and weighed. Errors may 
arise in faulty tracing, cutting, and 
weighing, and through nonuniform¬ 
ity of surface density of the heavy 
paper or foil. This method is rela¬ 
tively inaccurate. For rough work, 
it may prove convenient if a polar 
planimeter is not available. 

(d) Photoelectric Method . A photo- 
' electric device for measuring areas 
developed in part by the Botany 
Department of the University of 
Chicago is now offered commerci- 



Fig. 10. A photoelectric device for 
measuring areas. (Courtesy of the 
American Instrument Co.) 


ally by the American Instrument 

Company. Light from a low-voltage lamp (Fig. 10) is made parallel 
by a condensing lens, and then focused by a second lens onto a barrier 
layer photocell. The output of this cell is balanced in a suitable bridge 
arrangement by the output of a second cell, illuminated by the same 
lamp. The object whose area is desired must be opaque or translucent 
and must fit into a 10-inch circle. It is placed into the parallel light 
beam, thus reducing the output of the first photocell. The bridge 
circuit is then rebalanced by adjusting a slide-wire resistance which is 
calibrated directly in units of area. Advantages claimed by the manu¬ 
facturer are high accuracy, high speed, and no required operator ex¬ 


perience. 

6 . Summary. Methods other than those of differential and integral 
calculus are often desirable for obtaining values of dy/dx and f y dx. 
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To find dy/dx at the point (x,y) when the data are presented graphi¬ 
cally, we may determine the slope of the tangent (or sometimes of the 
normal) line, or obtain it by the more laborious and more exact secant 
method. The slope of the tangent line, and hence of the curve, is given 

by 



where {xi } y x ) and (x 2 ,i/ 2 ) are two points on the tangent line. 

If the slope of the curve at a specified point is to be obtained from 
the slope of the normal to the curve at that point, the equation to be 
used is 



of which ( dy'/dx a scale factor for the graph, represents the ratio of the 
change in y corresponding to a length measured along the ?/-axis to the 
change in x corresponding to the same length measured along the x-axis. 

When the secant method is used to determine the slope of a curve at 
a specified point, the slopes of various secants, all of which cut the curve 
at that point, are graphed as a function of Ax, the change in x in going 
from one point of crossing to the next. The secant slope for Ax = 0 is - 
the slope desired. It is convenient for data in tabular form. 

When the data are tabulated, we may use the equation 


dy 

dx 


Ax 



Af/o + 





(4n 3 - ISn 2 + 22 n - 





where (x 0 ,yo) is a tabulated point, Ay 0 , A 2 t/ 0 , etc., are successive tabular 
differences, Ax is the common tabular x-interval, and n = (x — xo)/Ax. 

To find f y dx , we may use one of the quadrature formulas for 

either tabular or graphical data. Important rules and formulas are 
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(1) the trapezoidal rule: 


A = J^ y dx = Ax + 2/2 + 2/3 4-1" 2/n-i + ^ j 


[14] 


(2) Simpson’s H rule: 

A = ^ [( 2/1 4- y n ) 4- 2 ( 2/3 4-2/5 4-) 4- + 2/2 4-2/4 4-)] [15] 

u 

(3) Simpson’s % rule: 


A = 


3 Ax 

T 


[(2/1 4- 2/n) 4- 2(2/4 4- 2/7 4- 2/10 4 ) 


4- 3(i/2 4- 2/3 4- 2/5 4- 2/6 4-)] [15] 


(4) Weddle’s rule: 


A = 


3Ax 

10 


[(2/1 4- 2/n) 4- 5(2/2 4-2/6 + 2/8 4 ) 

+ (2/3 + 2/5 + 2/9 + 2/11 4-) 

+ 6(2/4 + 2/10 + 2/16 4-) 

+ 2(2/7 + 2/13 + 2/19-1-)] 


[17] 



Measurement with a polar planimeter is a second method of finding 
y dx. Although especially well suited for measuring irregular areas, 

the planimeter may be used for all graphical data as well as for tabular 
data if these are first plotted. In “emergencies,” or for rough work, the 

cut-and-weigh method may be used for finding f y dx. 


PROBLEMS 


1. Using the plot containing three curves drawn in connection with Problem 2 of 
Chapter II, construct with care a graph showing TdB/BdT = f{T) for tungsten for 
the range 2000° K < T < 3000° K. Use the straight edge tangent or normal 
methods. Use different symbols for values obtained from the three different curves. 
What is your conclusion as to probable accuracies for the three sets of values? 

2. Using the data reported in Problem 2 of Chapter II, determine with the aid of 
a tabular method the value of TdB/BdT for tungsten at 2000° IC, 2200 K, 2400 Iv, 
2600° K, 2800° K, and 3000° K. Compare these values with those obtained in con¬ 


nection with Problem 1 above. 

3. Repeat Problem 2, making use of the graphical secant method. 

4. Using the data given below for the spectra! brightness of a black body at 2400' K 
as a function of wavelength, determine its brightness at that temperature using 
(1) the tabular trapezoid method using a 0.01 a interval, (2) the tabular trapezoid 
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method using a 0.02 n interval, (3) the tabular Simpson’s method, and (4) the 
graphical polar planimeter method. For (1), (2), and (3) use an adding machine if 
available. How do the four determinations check? 


X in 

. candles 
in 

cm fx 

X in 

A 4 

„ . cand 
B\ m 

cm 

0.41 

0.09 

0.61 

619 

.42 

0.38 

.62 

506 

.43 

1.36 

.63 

379 

.44 

3.30 

.64 

268 

.45 

6.59 

.65 

175.5 

.46 

12.45 

.66 

106.0 

.47 

22.4 

.67 

59.2 

.48 

40.0 

.68 

33.3 

.49 

69.6 

.69 

16.95 

.50 

124.0 

.70 

8.95 

.51 

221 

.71 

4.80 

.52 

358 

.72 

2.50 

.53 

487 

.73 

1.30 

.54 

606 

.74 

0.65 

.55 

706 

.75 

0.32 

.56 

786 

.76 

0.17 

.57 

828 

.77 

0.08 

.58 

830 



.59 

791 



.60 

716 




6. Prove the relation expressed by Eq. 7 a. 

6. Using the data of problem 8, p. 268, determine, to within 1 part in 100,000, the 
ratio of the mean (0° C to 100° C) calory to the 15° C calory. 

7. Show, for the case of a parabolic curve of the form y = a + bx 4* cx 2 passing 
through the points A, B, C of Fig. 4, that the area included within the boundary 
xiAcx&i, in accord with Simpson’s 3^ rule, is given by Ax(y\ 4- 4j/ 2 4- Z/s)/3. 



CHAPTER V 


FOURIER SERIES 


1. Introduction. A Fourier series is a convergent infinite series com¬ 
posed of sine and cosine terms whose successive angular values are pro¬ 
portional to the cardinal numbers, thus: 


y = f(Q) = a\ sin 0 + 02 sin 20 + a$ sin 30 + 
+ b\ cos 0 + cos 20 -f- &3 cos 30 + • • • 


* • 


+ - 
2 


bo 


2 '■E 


[ 1 ] 


Some authors use b 0 not b 0 /2 for the constant term. The reason for the 
present use will appear later. That certain series of tins type could be 
developed was known long before Fourier’s time, but certain of their 
properties as well as their possibilities in the solution of problems in the 
field of heat were not then appreciated. Fourier’s views, first presented 
to the French Academy in 1811, were published in 1822 in his Theone 

analytique de la chaleur. 

Fourier series represent means whereby a very large number of prob¬ 
lems of certain types may be solved. In such instances, their value lies 
in the fact that with their aid boundary conditions, even when highly 
complicated, may usually be expressed in forms which are compatible 
with the underlying differential equations of Laplace and of I oisson. 
Given the boundary conditions as to temperature for a sheet a rod or 
a block of material, certain of its physical characteristics such as den¬ 
sity, specific heat, and thermal conductivity, and the distribution of 
temperature throughout at some one instant, it is genei ally possi e to 
specify with the aid of these series the distribution of temperature 
throughout thereafter. In case, however, the distribution of tempera¬ 
ture at some instant cannot be ascertained, it is still possible to specify 
the steady state distribution. Analogous problems in acoustics, radia¬ 
tion, and electricity may be handled similarly. 

Industrial applications occur wherever vibrations are a matter of 
concern, as in the fields of electrical engineering, aerodynamics teleph¬ 
ony, music, radio, and sound projection. The designer for electrical 
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generators and transformers must meet a requirement of noninjurious 
harmonics (vibrations, multiples of the fundamental, which correspond 
mathematically to succeeding terms of a Fourier series), and the tester 
must know how to determine their presence and their intensities. The 
airplane designer must similarly guard against possible harmonics of 
frequencies that are unavoidably present in engine operation. The 
tester again must know how to detect their presence and to measure 
their intensities. In telephony, radio, and sound projection, distortions 
due to emphasizing or minimizing harmonics need to be reduced. In 
musical instruments, the harmonics introduced and properly controlled 
determine the quality of the instrument. In all the cases named, experi¬ 
mentally observed or recorded effects for a definite angle swept out, for 
a definite distance traversed, or for a definite period of time, are the 
bases for design, correction, or control. 

2. Functions Expressible by Fourier Series. Most of the functions 
which the experimental worker desires to expand into Fourier series 
involve angular displacement, time, or distance as the independent vari¬ 
able. Other physical quantities, of course, may be and are similarly 
involved. The dependent variables concerned are much more numerous. 
Of the many combinations, we may mention three of importance to 
industry: those concerned with (1) the graph of the electrical engineer 
showing instantaneous emfs or other electrical quantities for an AC 
generator, transformer, or circuit as a function of the phase angle, (2) 
the graphs of the builder of musical instruments showing the displace¬ 
ments of some portion of a string from its normal position as a function 
of time, and (3) the graphs of the vibration specialist showing displace¬ 
ments of the various parts of a structure in vibration as a function of 
position. 


Corresponding to these three groups of particular interest with inde¬ 
pendent variables represented in order by 0, t, and x, we shall develop 
Fourier series of the types, 


y = /(0), for 0 < 0 < 2?r 



y=f(^t) = F M,f°vo < t < T 



y = f (y = F 2 (x) , for 0 < x < X 



in which T represents the period of a simple harmonic motion and X a 
wavelength. In all three equations, the quantities in parentheses repre¬ 
sent angles, a necessary condition, since the series are trigonometric. 



109 


FUNCTIONS EXPRESSIBLE BY FOURIER SERIES 

Often, as suggested by Eqs. 2 to 4, the functions to be developed 
into Fourier series are cyclical. When graphed, inspection shows that 
a certain portion by successive repetition forms the whole. The mini¬ 
mum such portion forms a cycle. 

Illustrating such cyclical varia¬ 
tions, Fig. 1 shows the supplied 
potential difference, the current, 
and the instantaneous power for a 
particular capacitative circuit as 
a function of time. Harmonic fre¬ 
quencies which are multiples of the 
fundamental AC frequency are 
quite evident. 

Frequently in theoretical physics 
we are concerned with a distribu¬ 
tion of some quantity with distance 
in which there is no cyclical repe- 

/2tt ' 

tition for the function / — l 




Fig. 1. Oscillograms showing supplied 
potential difference, current, and in¬ 
stantaneous power for a particular 
capacitative circuit. ( Kerchner , R. II., 
ami Corcoran , G. F., Alternating Cir¬ 
cuits, p. 129, John Wiley & Sons, Inc., 
New York, 1938.) 


although the function itself extends 

to infinity. In this case, a Fourier 
series may be used, in which in effect X becomes infinite. The form of 

the series is modified, however, to become a double integral known as 
Fourier’s integral. This will be discussed later. 



Fio. 2. Graph of a function Riven by y = 0.59 for the range 0 < fl < - and by 

y = -tt/4 for the range n < 0 < 2 tt. 


The limitations as to form for a function of a single independent vari¬ 
able which may be expressed as a Fourier series, are surprisingly few. 
In fact, so long as a function is real, finite, single valued for the inde- 
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pendent variable and possesses only a finite number of finite discontinu¬ 
ities, a series may be found to represent it. One part of a cycle, if cycles 
are present, may have no apparent relation to another part. Illustrat¬ 
ing this feature, Fig. 2 shows a graph for which we shall develop a series 
later. 


3. Types of Fourier Series. The most common type of Fourier series 
is that represented by Eq. 1. It is known as a whole range sine-cosine 
series. However, for many purposes, it is desirable to have a different 
form of series in which the series of cosine and sine terms of Eq. 1 in 
pairs are combined to yield a series containing sine or cosine terms only. 
Doing so involves introducing phase angles in accord with the following 
equation. 


a m sin m6 b m cos md = a m 2 -j- b m 2 sin ( mO + tan 1 — ) 

\ Am/ 

= Vdm 2 + b rn 2 cos md — tan -1 


[5] 


Verification of Eq. 5 follows at once when its right-hand members are 
expanded in terms of sines and cosines of md and tan -1 ( b m /a m ). Eq. 1 
may be rewritten as 


y 


= f(°) = 2 ” + ^2 Am sin ( ' md + e ’ A 


00 


m = 1 


= ~ A m COS (md -f € ™ - ^ t 6 ] 

m = 1 

of which 

Am = y/ dm 2 + b m 2 [7] 

and 

e m = tan -1 — [8] 

Eq. G, in all respects the equivalent of Eq. 1, has an advantage over 
Eq. 1 in that it shows directly the phase relations for the various fre¬ 
quencies, which, though present in the form of Eq. 1, are not so evident. 
In the form of Eq. 0, each term separately, rather than by pairs as in 
Eq. 1, represents the whole contribution of a given frequency or har¬ 
monic. To distinguish harmonics from one another, each is given a 
number corresponding to its m. Thus for m = 1 we have the first har¬ 
monic or fundamental. Corresponding to m = 2, 3, 4, etc., we likewise 
have the second, the third, the fourth harmonics, etc. 



TYPES OF FOURIER SERIES 


111 


Making use of the well-known relations 

Am6 i _—imO 


cos md = 


+ e 


[9] 


and 


sin md = 


e iui6 _ e —im9 

2 i 


[ 10 ] 


Eq. 1 may also be expressed as 


co 


y 


= f(g) = b -° + I V [(fc„ - ia m )e^ + (b m + [11] 


m = 1 


The coefficients of e im# and e~ ime are conjugate, a characteristic often 
permitting considerable simplification of computations. Eq. 11 is much 

used. . lf 

In addition to the whole range sine-cosine series, there is a half-range 

sine series 

oo 

= h (*) = E a m sin md 

m— 1 

and a half-range cosine series 

Po 

y = hW) = 2 


y 


[ 12 ] 


= /aW = S ^ 

^ m = 1 


cos m# 


[13] 


A sine series, as is more or less evident, yields a graph (Fig. 3 A) which 
is symmetrical with respect to the origin or to points on the 0-axis where 




Fig. 3. (A) 


Graph of a sine series. (B). Graph of a cosine series 

0 < 0 < 7 T, the graphs are alike. 


For the range 


g = ±H 7 r Similarly the half-range cosine series yields a graph (Fig. 
3B) which is symmetrical with respect to lines perpendicular to the 
0-axis at these same points. These series will be discussed more fully 

later. 
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Lastly we refer again to Fourier’s integral, a limiting form for a 
Fourier whole range sine-cosine series when the range of the cycle is 
infinite in extent. We shall discuss it later. 

In what precedes, it has been tacitly assumed that the origin of co¬ 
ordinates for a problem has been somehow fixed and that the series has 
been developed accordingly. It is always possible, however, for the 
operator to select what shall be the beginning and the ending of a range. 
When the function is cyclical, certain points will appear more natural 
than others for such choices. If, for instance, there are two loops to 
the graph of a cycle, one positive and the other negative, and both are 
of equal length, a point of intersection of two succeeding loops with the 
0-axis may be chosen as the origin. Instead, however, a point midway 
between two such successive intersections will sometimes be chosen. 
Which choice is to be made will depend to some extent on the type of 
series desired and that will usually depend upon other considerations. 

4. Some General Considerations. That Fourier series will converge 
has been shown. The proof, which is said by Byerly 1 to be “elaborate,” 
is assumed and accepted here. 

Connected with this feature of convergence are the questions of inte- 
grability and differentiability. Granting convergence, it is easily seen 
that a Fourier series may always be integrated though not always differ¬ 
entiated. To illustrate, the integral of /(0) r/0, as expressed in Eq. 1, 
when integrated term by term, yields 

f f(0) dO = ai (1 — cos 0) + ^ (1 — cos 20) ~ (1 — cos 30) H- 

Jo 2 3 

-f- — 0 -f* b\ sin 0 + " sin 20 -f ~ sin 30 H- [14] 

2 2 3 

while the derivative is given by 

— /(0) = ai cos 0 -f- 2 a 2 cos 20 -j- 3a 3 cos 30 H- 

dO 

— [bi sin 0 -f 2b 2 sin 20 + 3 b 3 sin 30 -j- • • •] [15] 

Granted that the coefficients of Eq. 1 form a converging series, it is 
evident that those of Eq. 14 will also converge, since term by term, in 
comparison with those of Eq. 1, the coefficients of Eq. 14 are progres¬ 
sively smaller. At the same time the coefficients of Eq. 15 term by term 
are progressively greater. While convergence is always assured for the 
integral, it is not so assured for the derivative. 

1 Byerly, W. E., Fourier's Series and Spherieal Harmonics, Ginn & Company 
1893, p. 38. 
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Two questions may be properly asked at this point. (1) Is it piob- 
able that a smooth curve, for example one of those shown in Fig. 1, 
can be represented faithfully by a sine-cosine series, or is it just an 
approximation? (2) For a graph of the type shown in Fig. 2, what 
value or values does f(x) possess at 9 = tt (strictly tt radians)? Reply¬ 
ing to the first question, the answer is that an equation with an infinite 
number of arbitrary constants can be made to yield a locus which passes 
through an infinite number of chosen points. Viewing a series as such 
an equation and the line of a graph as the aggregate of such a selection 
of points, the probability seems reasonable. Further, tests with actual 
series seem to indicate no exception to the possibility. As to question 
(2), the answer is that the computed value of f(9) for 9 = -tt for the func¬ 
tion graphed in Fig. 2 is represented by a point midway between the 
line y = 0.50 at 9 = tt and the line y = — ir/4. The exact value is 

5. The Coefficients of the Whole Range Sine-Cosine Series for/(0). 

The well-recognized procedure for determining the coefficients of Eq. 1 
follows (1) Multiply both sides of Eq. 1 by the sine or cosine factor 
of a selected term on the right. (2) Integrate both sides of the equation 
obtained with respect to 9 between the limits 0 and 2 tt (strictly 2 tt 
radians). (3) Evaluate the coefficient of the term whose sine or cosine 
factor was chosen for the first step. To illustrate, we shall evaluate 
a m , b 0t and 6 m , of which m represents any other subscript than zero. 

Steps one and two yield 



sin m9 dO = 


c • 

/ SI 

J 0 



2 IT 


sin 9 sin m.9 d9-\- / a 2 sin 29 sin m9d9+ 


• • • 


+ 


J f 2 * 

(i m sin* 
o 


m6 d9 


, f 2 'b o . 
" + 1 2 


sin rruS d9 


f*" 

+ j b\ cos 9 sin md d9 H- 

J o 


[16] 


= tt a m 

Step three leads at once to 


1 


TT 



sin m9 d9 



r 2 » 

Except for the term / a m sin 2 md d0, all terms on the right of Eq. 10 

separately equate to zero. That this is true can be shown rather simply 
either mathematically or physically. 
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Similar procedure for b 0 , understanding that the trigonometric factor 
multiplying it in the series is 1, leads to 


r'2x /*2x s*2t 

I f(6 ) dd = / cii sin d dd -f- / a 2 sin2ddd -f- 

Jo J o Jo 




r*b o 
Jo 2 


dd 


+ 




cos 6 d6 - j- 


• • 


[18] 



In like manner b m may be evaluated, and we obtain 

i r 2r 

b m = - / f(d) cos md dd [20] 

TtJ 0 


Eq. 20 evidently includes Eq. 19 as a special case. With m equal to 
zero cos md becomes 1. 

With recourse to tabular or graphical integration if necessary, it now 
becomes possible to determine the coefficients of the series of Eq. 1 
when f{d) is expressed either in equation form or graphically as in Fig. 1. 
The process may or may not be tedious, depending largely on the num¬ 
ber of terms that must be used to obtain the desired accuracy. For¬ 
tunately, a series often converges so rapidly that only a few terms need 
be evaluated. 

6. Evaluation of the Coefficients for a Particular Whole Range Sine- 
Cosine Series. To illustrate the procedure, we shall make use of the 
function graphed in Fig. 2. Its value is given by f(d) = d/2 for the 
range 0 < d < tt and f(d ) = — 7t/4 for tt < d < 2n r. There is a discon¬ 
tinuity at d — 7r. Eqs. 17, 19, and 20, applied directly, yield 


a 


m 




sin md dd -f- 



7T 


sin md dd 


[ 21 ] 





[ 22 ] 




- — 1 
2m J 


[23] 


m even 


1 As stated above, some authors use bo not bo/2 as the constant term of Eq. 1. 
For them the value of bo is just x / 2 that given by Eq. 19. Using 6o 2 for the first term 
has the advantage that, when so used, the general equation for the various b m s 
applies to bo also. 
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h ° -\[ £ + f tH - 0 

i r f w e , /' 2,r — 7T 

= - / - cos md d9 + / -7- cos 

7T L 7 0 2 X 4 

77l 2 7T jw odd 
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[24] 


m 


md dd 


[25] 


m 


v = /(e) = 


[5 m — 0] m even 

sin 0 - sin 20 + l - sin 30 - sin 40 + 

— - I COS 0 + 72 C0S 30 + 72 C0S SO + • 

x L 3 n 


[26] 

[27] 



[28] 


Checking shows the following relation between 0 and the computed/(0) 

5x *3x 7 x 


0 


0 


X x 3x _ _ _ 

7 2 T ^ 4 2 4 


2x 


/w 


— x 


8 


X 

8 


X 

4 


3x 

~8~ 


X 

8 


— X 


— X 


— X 


— X 


8 


As expected, /(0) for 0 equal to 0, x, and 2x is the mean of the values 

predicted separately by the two lines of the graph. 

7. The Half-Range Series for /(0). If one is interested in the values 

for /(0) only for the range 0 < 0 < * or if the portion for the iange 
x < 0 < 2x is symmetrical in either of two ways with the poition foi 
the range 0 < 0 < x, one has the possibility of developing the function 
for one or the other of two half-range series, a sine series corresponding 
to the a terms of Eq. 1 and a cosine series corresponding to the b terms. 
Generally such half-range sine or cosine series are preferied to whole- 
range series since they involve less labor. Moreover, through contain¬ 
ing terms of one type only, they make it possible in certain computations 
to comply with certain boundary conditions when otherwise it would 

be impossible. 

If the graph of the whole range is symmetrical with respect to a point 
on the 6 -axis at 8 = 0, tt, 2r, etc., that is, if the function is odd, as m 
Fig. 3 A, the series can evidently contain only sine terms. The term 
c^sinTrtS, whatever the value of in, will have values of opposite signs 
though of the same magnitude when successively tt - 6 and x + S are 
substituted for 6, while, for the term b„, cos md, the corresponding values 
will be both of the same sign and the same magnitude. Obviously, on 
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the other hand, if the graph of the whole range is symmetrical with 
respect to the perpendicular to the 0-axis at 0 = 0, 7r, 2tt, etc., that is, 
if the function is even, as in Fig. SB, the series can contain cosine terms 
only. 

Comparing A and B of Fig. 3, we see that they are identical in the 
portions in the ranges 0 < 0 < tt, though not generally elsewhere. It 
appears, and is the case, that a given line in the range 0 < 0 < 7r may 
therefore be represented by either a sine or a cosine series and also any 
number of combinations of part sine and part cosine series. Outside 
the stated range, however, all will differ. 

In developing a half-range series, the procedure for determining the 
coefficients is the same as that for the whole-range series. Assuming thus 

y = f 1 (0) = a\ sin 0 -f- ot2 sin 20 + «3 sin 30 + • • • [29] 


multiplying through by sin md, integrating with respect to 0 between 
the limits 0 and ir (not 2tt as for the whole range), and evaluating, one 
obtains 



2 r r 

a m = - 1 fi (0) sin md dO 

TT J { ) 

[30] 

Similarly for the half-range cosine series, assuming 


y 

= f 2 W = IT + 01 cos 0 + 02 COS 20 + 03 cos 30 H- 

[31] 

we obtain 



and 

A) = - / f 2 (o ) dd 
* */<) 

_ /» _ 

[32] 


2 r 

Pm = ~ 1 f 2 ( 0 ) cos md dd 

tt J () 

[33] 


Eqs. 30, 32, and 33 differ from Eqs. 17, 19, and 20 in that the constants 
preceding the integrals are twice as great and in that the upper limits 
of the integrals are one-half as great. It is of interest to note that, by 
change of the independent variable from 0 to 0 where 0 = 0/2, it is 
possible to obtain a normal half-range series for the new variable 0 
which is equivalent to the whole-range for 0. Referring to Fig. 2, for 
instance, the range 0 < 0 < tt would cover the whole range in 0, namely 
0 < 0 < 27r. Further, the appropriate half-range series in 0 in terms 
of cosines, say, once developed, can be converted by substitution into 
a cosine series in 0 with the (3 { term containing the angle 0/2. The func¬ 
tion for the whole range, as initially described, is now described by a 

cosine series. 



EVALUATING COEFFICIENTS FOR THE HALF-RANGE SERIES 117 

8. Evaluation of the Coefficients for Particular Half-Range Sine and 
Cosine Series. Consider a sine series to represent, between the limits 

0 and ir, the straight line whose equation is 

[34] 


V = /(») = | 


Substitution in Eq. 30 yields 





sin mO dO = d= — 


1 

m 


[35] 


with the sign positive when m is odd and negative when even. We have 

thprpfnrp 

y = fl (6) = sin 0 - i sin 20 + } sin 30 - * sin 4 6 +- ■ • [36] 

For the cosine series representing the same straight line in the range 
0 < 0 < 7T, we obtain 

~ * [37] 


00 


L 


'm 



cos md dd 


[38] 


When m is odd, ft. has the value - (2/«M; when m is even, its value 
is zero. There follows 


V = h(0) =\-\ ( cos 6 + h COS 


1 

5 


3 0 4- '2 c°s 5 0 + 


[39] 


By trial both Eq. 36 and Eq. 39 are found to check. The proce ** 

[40] 


1 + h + 1 * + f 2 + 


7r 
"8 


No trouble is experienced in checking Eq. 36 for similar values of 0, 
though one is helped at ir/2 by recognizing that 

..= * [41] 


1 , 1 1 , 1 _ 
1 3 + 5 7 + 9 


At 0 = it because of the discontinuity in /, «j) at this point, Rvalue of 

the function is midway between +*/2 and ir. . * , ibo the 

approached as a limit. However, both Eq. 30 and Eq 39 desc r bf t c 
Ze curve between 0 = 0 and 0 = x, though in the region outside they 


Fig. 4. Showing in downward progression the separate contributions of the successive 
terms of Eq. 3G (sine series) at the left and Eq. 39 (cosine series) at the right, and 
the successive approximations*^ the straight line y = 0 2 in the range 0 < 6 < *r. 

Each new term is represented by-and the approximation to the straight line 

produced by its inclusion by- 
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differ greatly. It is interesting to note the separate contributions of the 
succeeding terms of Eqs. 36 and 39 as shown in Fig. 4. It is very appar¬ 
ent that the cosine series converges the more rapidly. 

9. Series Representing y = f (yr ^ and y = f xj ■ It is well to 

repeat that here T represents the period of a simple harmonic motion, 
that of the fundamental of a vibrating system, and that X is a wave¬ 
length, that of the fundamental of a wave motion. The forms of the 
whole-range and half-range series are like those for y = f(0). Their 
coefficients may be obtained by procedures exactly like those used in 
obtaining corresponding values for f(6). Thus, for the whole-range sine- 

cosine series, we have 




For the half-range sine series, we have 



[45] 

[46] 


For the half-range cosine series, we have 


/2* 

V 2 \f 


t) = T + S p ' m c>os ( 

/ “ m = 1 x 


2tt 

m y 1 


p 


i r >■ (? o 

- - f £ * (?') 


dt 


[47] 


[47a] 


cos \ m 



dt 


[48] 


An analogous equation involving / x) is obtained by substituting 
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x and X for t and T of Eq. 42, and the equations for coefficients a" m , b" m , 
a "my and (3" m for the ( x ,\) series are exactly like Eqs. 42 to 48. 

If in Eqs. 17, 19, and 20, one replaces Q by ~ t and — x, he obtains 

1 X 

for a rn , b 0 , and b m , identically the expressions for the primed and the 
double primed constants of Eqs. 42 to 48. This indicates that a m , a' m , 
and a" m , for instance, are the same quantity arising in different connec¬ 
tions. That in these expressions we have 2/T and 2/X where before we 
had 1 /tt is a consequence of the fact that the cycles for the independent 
variables here end when the values T and X are reached whereas in the 
preceding case it ended when 2?r not t r was reached. Some authors 
use 0 < t < 2T and 0 < x < 2X for ranges. In that case the constants 
preceding the integrals of Eqs. 42 to 48 are reduced to l/7\ 1/X, etc. 

10/ The Limiting Series for the Range 0 < x < oo and Fourier’s 
Integral. With the understanding that X of the series 

y=; (t x ) == ! 



will be allowed later to increase indefinitely, recognizing that X will then 
no longer represent a wavelength, let us replace it by 1. We then have 


= b i + 

in which 




Substitution in Eq. 50 yields 


[50] 

[51] 
[51a] 

[52] 
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Since definite integrals are functions of their limits, we may, in order to 
avoid confusion, replace the symbol x where found within such an inte¬ 
gral by some other symbol, say m- Then we may write 


/ 


+ 




+ / Fill) COS ( m 


2tt 

l 



cos l m 


2t r 

l 



dn [54] 


Inspection shows the possibility of replacing a combination of terms 


, 2tt \ / 2tt 

such as cos l m —- nj cos yn ^ 




l 


by 


cos m 


2tt v 

T ^ - a J’ 


Hence we write 


Fix) 



f( M ) d M + 7 y] f ^(m) cos f m y (m - x) 1 dp [55] 

1 t^i “'o L 

Let the summation be now changed so as to extend from m = ~ to 
m — _}_oo. Since the cosines for negative m’s are equal to corresponding 

ones for positive m’s, no trouble is experienced. At the same time, the 

multiplier of the summation changes to 1 /l and the - J F{p) dp 
now fits into the summation, and we have 


/Vo.) dp. ^2 

•/ 0 tn = — G 


,A f 

27r */n 


oo 


[56] 


7/i = — co 


If now l is increased without limit and ntin/l is treated as a new 
variable, v say, with its differential dv equal to 2 t r/l, Eq. 56 may be 

rewritten as follows: 


Fix) 




30 


F(n) dp I cos v(n — x) dv 


00 


]o<z< 


[57] 


oo 


Though no change in value for the integral occurs when the order of 
integration is reversed, such reversal is found convenient and necessary 
in application. Thus reversed Eq. 57 becomes 


Fix) 



CO 


dv 



'{fi) cos v(fi — x) dfi 


o < z< « 


[581 
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Had we followed the procedure of certain other authors and developed 
series for the ranges — tt < 6 < tt, — T/2 < t < T, — X/2 < x < A/2, 
instead of 0 < 6 < 2i r, 0 < t < T, 0 < x < \, the relation obtained in 
place of Eq. 58 would have satisfied the range — *> < 0 < oo. Its 
form, slightly different, is the following: 

[ 2 ✓*+<*> /•+» “j 

= — / dv I <t>(v) cos — x) dfi\ [59] 

7T J — ao i/ — oo J — 00 < X < -f- «> 

The right-hand member of Eq. 59 is known as Fourier’s integral. It is 
more inclusive than Eq. 58, which it includes as a special case. In 
making the transfer from one form to another, however, one needs to 
note that the portion of a function which is expanded in the range 
0 < x < l to yield Eq. 58 is different from that which is expanded in 
the range —1/2 < x < 1/2 , and that therefore the F(x) of Eq. 58 is not 
the <t>(x) of Eq. 59. 

Eqs. 58 and 59 are found indispensable in the solution of many prob¬ 
lems of theoretical and practical physics, involving electricity, magnet¬ 
ism, heat flow, x-ray analysis, etc. To illustrate its use here seems out¬ 
side the scope of the present work and will not be done. 

11. Special Cycles Consisting of a Positive and a Negative Loop. 
The graphs of many functions met with in practice show cycles consist¬ 
ing of a positive and a negative loop, both of the same extent along the 
independent variable axis. Because of certain characteristics, many of 
these permit of simplified treatment. Four cases will be discussed. 

Case I. The Area of the Positive Loop Equal to That of the Negative 
Loop. In this case the term of the whole range sine-cosine series involv¬ 
ing b 0 is zero. This is evident from Eq. 19, for the integral / f{9) dd 

Jo 

represents the area enclosed between the loops and the 0-axis; and, if 
this area is nil, the coefficient is likewise zero. The loops need not be 
of equal lengths in this instance. 

Case II. Positive Loop Asymmetric; Negative Loop a Displaced Image 
of the Positive Loop. An illustration is given in Fig. 5 at A. It is a cycle 
that is encountered frequently in electrical engineering. Evidently b Q 
is zero. For the further evaluation of coefficients, we have the condition 
that f{Q + tt) shall equal —f(6). This is met by both sine and cosine 
terms when only odd values of m are used since 


[sin mO = —sin m(fi + 7r)] m Q dd 
[cos mO = —cos m[0 -f 7r)] m G dd 


[ 60 ] 

[ 61 ] 
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Even values of m do not yield the change of sign. The type of series 
that satisfies Fig. 5 A is therefore the whole range sine-cosine series 

containing odd terms only, thus 

y = f(0) = oi sin 0 + a 3 sin 30 + a 5 sin 50 H- 

-f bi cos 0 -f- 63 cos 30 H- [62] 

In obtaining values for the coefficients it is evidently not necessary to 
integrate over more than one loop. In each instance the integial foi 
the whole range will be just twice that for one loop. 



Fig. 5. Three special cycles with graphs composed of a single positive and a single 
negative loop of equal extent along the axis of the independent variable. 


Case III. Positive Loop Asymmetric ; Negative Loop Possesses Point 
Symmetry with Respect to the Positive Loop. An illustration is given in 
Fig. 5J3. This type of wave may be met in various fields, in particular 
in sonics. The function is odd. An evident condition which must be 
fulfilled by the series is that /(tt - A) shall equal -/(tt + A). This is 
fulfilled by all sine terms whether m is odd or even. All cosine terms 

fail. Thus 

sin (mir — A) = —sin (tmr + A) [63] 


while 


cos (wtt — A) = cos (mir + A) 



It follows that Fig. 5 B will be described satisfactorily by a regular 
half-range sine series. 

Case IV. Positive Loop Symmetrical; Negative Loop Possesses Point 
Symmetry with Respect to the Positive Loop. An illustration is given in 
Fig. 5 C. This cycle occurs frequently. Obviously in this ca.se, as in 
case III, the function is odd and a half-range sine series suffices. There 
is an added condition, however. Here }{t/2 -f A) equals f(ir /2 — A). 
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This condition is fulfilled by sine terms only when m is odd. The series 
then takes the form 

V — f(P) = «i sin Ha 3 sin 30 + a 5 sin 50 H- [65] 

While integrating to obtain values for the coefficients, one needs only 
to integrate over one-half of the first loop. Because of symmetry the 
integral for the whole loop is twice that for the half. 

In this case, were a shift of the origin made to the middle of a loop, the 
series required would be a half-range cosine series with odd terms only 
present. The even terms are eliminated by the condition of point sym¬ 
metry demanded for 0 ' = tt/2 in the shifted coordinate system. 


12. Tabular Integration Method of Obtaining Series Coefficients. 

As the function to be used in illustrating a procedure suitable for such 
determinations, we make use of an oscillogram 1 (Fig. 6 ) which is rather 
similar to the instantaneous power oscillogram of Fig. 1. The cycle in¬ 
volved is of the type described under case II of the preceding section. 
Our task is that of determining coefficients a j, a 3 , a 5 , • • • b\ y b 3) b 5l 
Kerchner and Corcoran in the reference cited give values for the in¬ 
stall taneous current at 5° intervals between 0° and 180° beginning at 
0°. To these we shall apply Eqs. 17, 19, and 20, using a tabular trape¬ 
zoidal method of integration as described in Chapter IV, rather than 
the slightly different procedure used by the authors. How it is carried 
out is shown in Table I, where values have been determined for a\, 61 , 
a 3 , and b 3 . Similar procedure will yield values for the a’s and b } s of 
higher harmonics. As tabulated, one sees that the same numeric occurs 
frequently as a sine or a cosine factor. If a slide rule or computing 
machine is used in making calculations, much time may be saved by 
setting the rule or computing machine so that successive multiplications 
involving such a numeric can be carried through conveniently. 

Collected values for the desired series are given in Table II. Because 


of the slightly different procedure mentioned, the constants for the funda¬ 
mental or first harmonic and for the third harmonic differ slightly from 
those obtained by Kerchner and Corcoran. Values for the fifth and the 
seventh harmonics, however, are those which they obtained. 

In evaluating the e m ’s for a series of the form of Eq. 6 , one must choose, 
in each case, between two supplementary angles with the same value of 
tan e, n . Which angle to take depends on the signs of the coefficients 
a m and b m . Referring to Eqs. 7 and 8 , it is seen that they may be solved 
simultaneously for a„, and b m in terms of A m and e m to yield a rn = A m 
cos e m and b m = A m sin €„,. With A mi as defined by Eq. 7, taken as 


1 Kerchner, R. M., and Corcoran, G. F., op. cit., p.139. 
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essentially positive, it follows that cos e m has the same sign as a m and 
that sin €« has the same sign as b m . With this understanding, the ranges 
for various initial phase angles € m that correspond to various combina¬ 
tions of positive and negative signs for a m and b m are those shown in 



Phase Angle 

Fig. 6. An oscillogram showing instantaneous current as a function of phase angle 
for one-half of a cycle. The area between the trace and the phase angle axis has 
been subdivided into 36 portions by vertical lines drawn at 5 degree intervals. 
(Kerchner, R. H., and Corcoran, G. F., Alternating Currents, p. 139, New York. 
John Wiley and Sons, Inc., 1938.) 

Table III. These relations are also shown graphically in Fig. 7 where 
a m and b m are treated as x and y components of a vector. As is evident, 
a positive t m for the range tt < e m < 2 t r may be treated as a negative 
€ m with a corresponding value between 0 and tt. 

As a result of the analysis summarized in Table II, and the interpre¬ 
tations of Table III and Fig. 7, we may now write the series to and in¬ 
cluding the 7 th harmonic in the two following equivalent forms, from 
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which the names of the units accompanying the constants have been 
omitted. 

V = 82.3 sin 0 - 22.1 cos 0 - 0.90 sin 30 + 26.0 cos 30 

- 5.38 sin 5 6 - 3.65 cos 50 + 2.01 sin 70 - 1.29 cos 70 [66] 
y = 85.1 sin (0 - 15.1°) + 26.0 sin (30 + 92°) 

+ 6-3 sin (50 - 146°) + 2.4 sin (70 - 33°) [67] 


TABLE II 

Collected Values for the Constants of Series of the Type of Eqs. 1 and 6 
to Represent the Instantaneous Current Oscillogram of Fig. G, Data for 
Which, Taken from Measurements by Kerchner and Corcoran, 1 Are Given 

in Table I 


Values for the fifth and seventh harm onics are t hose which they computed. Units 

for a m , b m , and V / a m 2 -f b m 2 are arbitrary. 


\ 

Con- 



A 


b m 

Quadrant 

h 

Har- 

. stant 

^ m 


A m 

or 

— or 

for a 

_i u m 

tan — 

monic 

\ 



y/a m 2 


dm 

tan e m 

Positive 

(bn 

or € m 

Fundamental 

82.3 

- 22.1 

85 

.1 

- 0.269 

4th 

- 15.1° 

3rd 


- 0.90 

2G.0 

26 

.0 

-28.9 

2 nd 

4- 92.0° 

5th 


- 5.38 

- 3.65 

6 

.3 

+ 0.679 

3rd 

-145.9° 

7th 


2.01 

- 1.29 

2 , 

.4 

- 0.640 

4th 

- 32.6° 


TABLE III 

Showing Connection Between the Signs of a m and b m of the Whole Range 
Sine-Cosine Series of Eq. 1 and the Range of the Corresponding c m , Con¬ 
sidered Positive, of Eq. 6 When the Series Is Shifted to That Form 


Sign of a m 

Sign of b m 

Range of t m 

+ 

+ 

° < ‘" < 2 

— 

+ 

7 r 

~< e m < ir 



3tt 



IT < (m < — 

+ 

— 

37T 

~ e m < 2 tt 


1 Op. cit. 
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Inspection of Eq. 67 shows that the contribution of each harmonic 
has decreased with the increase in its order. It is probable that the con¬ 
tributions of the harmonics of still higher orders are negligible but such 
is not certain without further tests, one of which consists in finding the 
differences between the measured y 1 s and the computed y s, using Eq. 

66 or Eq. 67. 

With regard to accuracy, it is easily seen that as the order of the har¬ 
monic increases, the uncertainty with respect to the magnitudes of the 




Fig 7 Showing a vector graph useful in determining the range of e m of Eq. 6 and 
hence in determining a phase angle when its tangent is known. The graphs repre¬ 
sent conditions for the fundamental and the third harmonic shown in Table II. 

amplitudes also increases. Referring to the computations for the first 
and third harmonics as shown in Table I, it is seen that the range of 6 
for which a given y is assumed to be an average is three times as great 
for the third as for the first harmonic. For a higher harmonic the range 
is correspondingly greater, with an uncertainty that is also correspond¬ 
ingly greater. 

Certain time-saving, tabular methods 1 have been developed for the 
determination of the coefficients of a Fourier series. Reference to such 
shortened methods is recommended for one who is limited by circum¬ 
stances to the tabular method and has several determinations ahead of 

him. 

i Lipka, Joseph, Graphical and Mechanical Computation, Chap. VII, New York, 
John Wiley & Sons, Inc., 1918. 

Running; T. R., Empirical Formula*, p. 74, New York, John Wiley & Sons, 1917. 
H. O. Taylor, Phy s. Rev., 6, 303 (1915). 
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13. The Rolling Sphere Harmonic Analyzer. The discussion here is 
based on a description of the construction and operation of an Henrici 1 
analyzer by D. C. Miller. 2 In theory it is a device for the mechanical 
determinations of areas corresponding to the various integrals 

1 r 2x 

dm = - / /(0) sin md dd 

* Jo 

and 

1 r 2x 

b m = - I f(0) cos md dd 
ttJo 

Obviously, given a certain f(0) (Fig. 8A), it is possible to plot various 
curves (Fig. 8C) corresponding to the various integrands described by 


[17] 

[ 20 ] 



Fig. 8. Graphs illustrating: graphical harmonic analysis, using ordinary planimeters. 
A, Graph of function; B, graph of sine factor of the third harmonic; C, graph of 
f(0 ) sin 30 as a function of 0. 

Eqs. 17 and 20 and then to determine areas with the aid of an ordinary 
planimeter. Such curve plotting, one for each coefficient, would be very 
time consuming, and a machine to be of value must eliminate much of 
such procedure. This the Henrici instrument does. 

Integration of the right-hand terms of Eqs. 17 and 20 by the “inte- 
grat ion-by-parts” method, replacing f(d) by y, yields 

1 Henrici, O., Phil Mag., 38, 110 (18tH). 

2 Miller, D. C., J. Franklin Inst., 182, 285 (1916). 
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<bn 


r i V* 1 r 

— - y cos mO H-I 

L mir Jo wii r J e=zO 


0=2 ir 


cos 7nd dy 


and 


i I 2 ' i r 6 = 2 * 

b m = — 2 / sin me\ -/ sin cfy 

\_imr Jo miv J o= o 


[6S] 

[69] 


The first member on the right of Eq. 69 is obviously equal to zero. If 
now, as conditions precedent to the use of the Henrici instrument, con- 
ditions are so determined that 


[y = f( d ) = 0U 

0 = 2r 



the first member on the right of Eq. 68 also becomes zero. 
69 then become 


| /^0=2jt 

dm = - / 

mr J 0=0 


cos md dy 


and 


| s>d=2ir 

6m --/ S > 

rtlTT J 0=0 


sin md dy 


Eqs. 68 and 


[71] 

[72] 


These are the basic equations governing the construction of Henrici’s 
instrument. Interestingly the sine coefficients now contain a cosine 

integral and vice versa. 




Photo K raph of an Henrici harmonic analyzer with a curve in position to be 
analyzed, (ftfiller, D. C ., J. Franklin Inst., 182, 285, 1916.) 


Fig. 9 shows a photograph of a completed instrument with a curve 
to be analyzed in position. This curve must be plotted so that a certain 
linear distance, s to b in the figure, shall represent the angle 2 tt radians. 
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If there are discontinuities, lines perpendicular to the 0-axis are drawn 
to connect the branches at the point of discontinuity. In operation this 
curve is traced by the stylus shown with its point at s. During the 
tracing, the wheels ?'i, r 2 , r 3 roll backward and forward, carrying the 
superstructure. Two of these wheels and r 2 have a common axle 
shaft that carries five other wheels which, however, do not touch the 
paper on which the graph has been plotted. Each of these five wheels, 
of which two are shown in Fig. 10, supports a glass sphere which is 



Fig. 10. Photograph of a portion of an Henrici harmonic analyzer showing relation 
of rolling spheres to the adjacent integrators. (Miller, D. C., Idem.) 


rotated by it. Their rotation d<t> about an axis (the <£-axis) parallel to 
the line sb of the graph of Fig. 9 corresponding to a change dy on the 
graph is strictly proportional to dy. Obviously in accord with Eqs. 71 
and 72, it is still necessary to multiply each dy bv its appropriate cos mO 
or sin mO and to sum up such products. For this purpose, as shown in 
Fig. 10 and in plan in Fig. 11, two rolling sphere integrators are kep 
in contact with each sphere. These integrators in contact with any one 
sphere are oriented at l ight angle's to each other and contact the sphere 
at points separated by 90°. 

As the stylus (Fig. 9) is moved along the curve, a vertical shaft moves 
lengthwise of the superstructure and with it a wire is moved which passes 
around the pulleys at the tops of the frameworks about the glass spheres. 
The diameters of these pulleys vary as 1 '. Yz '■ Y '• J4 : Yb and in size 
are such that, with the passage of the stylus from s to b , they in turn 
make just 1, 2, 3, 4, and 5 rotations. With the stylus at s the frame¬ 
works about all of the spheres are set for the position mO = 0. Then, 
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with a slight movement of the stylus, there will be equal slight rotations 
d(f> of all spheres about the <£-axis proportional to the dy of the stylus 
motion. The integrators for the sine terms $ will automatically weight 
this <t> according to cos 0° or unity in conformity with Eq. 71 and those 
for the cosine terms c will similarly weight the d<t> according to sin 0° or 
zero in conformity with Eq. 72. With further motion of the stylus, 
however, the frameworks carrying the integrators are shifted to gradu¬ 
ally varying orientations about the vertical axes through the spheres. 
The positions for md = 0° and md = 30° are shown in Fig. 11. 



Fig. 11. Diagram showing the positions of the rolling sphere integrators in contact 
with the with sphere for positions corresponding to md = 2nir +0° and md = 2nw 
+ 30°. Integrator S yields the sine component, integrator C the cosine component, 
of the mth harmonic. 


As reflection will show, with the passage of the stylus from s to b 
(Fig. 9), the framework about the mth sphere will make m complete 
rotations and the s and the c integrators will give indications propor¬ 
tional to a m and b m as given in Eqs. 71 and 72. With dimensions prop¬ 
erly chosen proportionality factors, except for l/?n, may be made unity. 

In use, the changes in the integrator readings with shift of the stylus 


from s to b (Fig. 9) yield the first five sine and cosine coefficients, not 
6 {) , however. A set of the (>th to 10th coefficients, etc., can be obtained 
with the aid of other sets of pulleys at the tops of the frameworks carry¬ 
ing the integrators. In anticipation of such changes double pulleys are 
provided as shown in Fig. 10. Compound pulleys with larger diameters 
d\ and d 5 to yield 4 and 5 rotations per change of 2x in 6 have also smaller 
diameters and c/ 10 to yield 9 and 10 rotations for the same change in 6. 

Henrici’s instrument fails to yield a value for b 0 /2. Ordinarily for 
cases treated with an analyzer, this term is of little significance. Should 
need be felt for obtaining it, one may use an ordinary planimeter to 
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determine the area between the curve and the base line containing 
the points 5 and b (Fig. 9) and then divide this area by 2 t r radians. 

By comparing the analyses of known mathematical functions obtained 
mathematically with those obtained by his Henrici analyzer, Miller 
demonstrated that the analyzer possessed “an inherent accuracy much 
greater than can be taken advantage of in graphic work.” He stated 
that “The results are always accurate to a fraction of the width of the 
line representing the curve, and this precision is maintained uniformly 
for all the components, even to the thirtieth.” 

This judgment was based in part on the reconstructions of the original 
curves which were obtained with the aid of a harmonic synthesizer 1 
which he likewise described. 

Miller has also compared the speed with which results may be ob¬ 
tained, once data in the form of the required curve are given, with those 
for obtaining results by tabular methods presumably somewhat like 
that illustrated above. Of the results of three analyses of the same 
curve, the sound wave for an organ pipe, he states that the time required 
for the first ten harmonics by this method was 13 minutes, that the 
time required by the tabular method involving complete numerical re¬ 
duction from 30 ordinates was 10 hours, and that the time required by 
another tabular method with a prepared schedule which used only 18 
measured ordinates and yielded only 8 harmonics was 3 hours. Evi¬ 
dently, where much work is to be done in analyzing curves, a harmonic 
analyzer is a necessary instrument. 

14. Other Mechanical Analyzers. Without doubt analyzers of the 
Henrici type are among the best obtainable. Among purely mechanical 
instruments, they represent the best. As other instruments in common 
use, we have the common vibrating reed frequency indicator of elec¬ 
trical power stations, and the Chubb 2 polar analyzer (Fig. 12) which 
is found in electrical laboratories and power stations. The reed instru¬ 
ment requires a sustained repetition of the /(0) but no manual or other 
graphing of it. It can, however, only give indications of harmonics 
present and of their relative amplitudes. It cannot, at least as con¬ 
structed at present, show phase relations. The Chubb polar instrument 
requires a graph on polar paper, which is mounted in use on a circular 
gear-driven table. Each sine and cosine term requires a separate ad¬ 
justment of gears. There are two motions, one of the table forward and 
back along a straight track, the other a rotation of the table with m 
cyclic trips on the straight track for each rotation. The tracer arm 
which moves only perpendicular to the straight track has the tracer 

1 Miller, D. C., ./. Franklin Inst., 181, 51 and 285 (1916). 

2 Chubb, L. W., Elec. J 11, 91 (1914). 
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point of an ordinary polar planimeter inserted in a hole at one end. 
The area swept out by this tracer point during a cycle, in any particular 
instance, is proportional to the corresponding a m or b m . From the series 
of values obtained, an analysis for f(9) similar to that represented in 
Eq. 1 is obtained. 



Fig. 12. A diagram showing the principles of operation of the Chubb polar harmonic 

analyzer. 

16. Nonmechanical Harmonic Analyzers. Although the Henrici 
analyzer method saves much time in comparison with the straight 
tabular method, it is still time consuming. Other methods for specific 
purposes may be much superior through not requiring the plotting of a 
curve or by virtue of employing automatic integrating devices. Gener¬ 
ally, however, these improvements have been at the expense of precision 
in the analyses obtained. Where, as is often true, time and expense are 
important factors, some one of these methods may be more desirable. 

In a sense these methods are also mechanical because of the mechani¬ 
cal devices employed, but they are here classed as nonmechanical be¬ 
cause their important features depend upon photoelectric, electronic, 
electromagnetic, etc., effects. 

The basic theories for all analyzers start with Eqs. 17 and 20 and are 
necessarily much alike. It is necessary in all instances to multiply in 
effect an f(6) by a cos md and by a sin md where ordinarily a separate 




136 


FOURIER SERIES 


operation must be performed for each value chosen for ?n and sometimes 
for each cosine or sine multiplication. Further, phase relations must 
be controllable with precision. 

A simple harmonic analyzer dependent on photoelectric and elec¬ 
tronic effects was patented in 1933 by Marrison, 1 of the Bell Telephone 



Fig. 13. A diagram to show the principles of operation of the Marrison photoelectric 
harmonic analyzer for the case where only the amplitudes of the harmonics are to 
be determined. ' 

Laboratories. The main features of the method are shown in Fig. 13. 
The function f(9) is conveniently laid out in polar coordinates either by 
the appropriate blackening of a transparent circular plate disc or by 
cutting each disc to form a template as shown in Fig. 14. The dotted 
line is the axis of zero amplitude. Whichever way prepared, the f(0) 
disc is mounted on a motor whose speed of operation may be varied 

conveniently and precisely as desired. Thus 
mounted as shown at C in Fig. 13, it is 
rotated in the plane of the image of a line 
source of light A, formed by a simple 
convex lens, B. Back of this image plane, 
the light beam modified by the rotating 
f(0) enters a photoelectric cell, D, the out¬ 
put current of which passes to an amplifier, 
E. The output of E in turn passes to a 
filter, F, selective at a fixed frequency, and 
to a current meter, G, of the desired sensi¬ 
tivity. 

Let the characteristic frequency of the selective filter be arbitrarily 
fixed at 100 cycles/sec. In accord with this choice, the procedure for an 
harmonic analysis follows. The motor M is driven first at a speed of 
100 rps and the indication of meter G is read. Obviously, with all fre¬ 
quencies but 100 per second eliminated by F , the reading of G is a meas- 

1 Marrison, \V. A., U. S. Patent 1,901,400. 



Fig. 14. An f(6) set up in 
polar coordinates for use 
with the Marrison har¬ 
monic analyzer. 
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ure of the amplitude of the first harmonic or fundamental of /(0). 
Next the speed of M is reduced to 50 rps and the indication of G is read 
once more. At this speed a component of /(0) whose frequency is 
twice that of the fundamental will be repeated 100 times per second in 
• the output of the photoelectric cell D and will have its amplitude 
recorded at G. Similarly the amplitudes of succeeding harmonics may 
be obtained by operating the motor at speeds of J/^, } e tc., of 
100 rps. Once /(0) has been properly transferred to the motor-driven 
disc, the time required for the amplitude analysis is very brief. 



Fig. 15. A diagram to show the principles of operation of the Marrison photoelectric 
harmonic analyzer for the case where amplitudes and phase relations are both 

determined. 

Unfortunately the analysis just described gives no indications of phase 
relations. For this Marrison proposes, as shown in Fig. 15, the sub¬ 
stitution of an electrically driven tuning fork—with mirror I attached, 
a light beam J, and a moving photographic film K to replace the filter 
F and the meter G shown in Fig. 13. Obviously a harmonic being 
analyzed will be shown drawn out as a sine curve with an amplitude 
proportional to that of the harmonic. For the phase determination, a 
straight-line trace on the same moving film is produced by light re¬ 
flected from a mirror which is stationary except for a small jog produced 
once each rotation of the motor by an appropriate contact mechanism. 
Fig. 16 is given by Marrison as the analysis of the /(0) of Fig. 14. Ob¬ 
viously the three components agree precisely in their phases for one 
particular value of 6 and differ in amplitudes. 

Another optical analyzer using photoelectric effects for its integra¬ 
tions has been constructed by Wente 1 and described by Montgomery. 2 
In the instrument described, the f{6) is represented by a variable area 
record or by a variable density record such as are found on photographic 

i Wente, E. C., U. S. Patent No. 2,098,326. 

a Montgomery, H. C., Bell System Tech. J., 17, 406 (1938). 
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films for sound reproduction, while the cos mQ and the sin mQ factors 
are represented by similar records of the variable density type only. 
The/(0) record may vary from 1/16 inch to 5/16 inch in length and must 
not be higher than long. The sine and cosine factor records are about 
1 inch by 2 inches. In operation the /(0) and a cosine or a sine record 



Fig. 16. The graphical analysis of the/(0) of Fig. 14, 

according to Marrison. 

are mounted in an optical system (Fig. 17), and light from an incan¬ 
descent lamp is passed through to a collecting photoelectric cell whose 
response is an integrated product of the transmittances of the two rec¬ 
ords. By successive substitutions of the various sine and cosine records 
other corresponding photoelectric responses are obtained. Certain cor¬ 
rections must necessarily be taken into account. Although negative 

Photo- 



Fig. 17. A diagram showing the optical arrangements for an analysis using Wente’s 
optical harmonic analyzer. ( Montgomery , H. C., Bell System Tech. J., 17, 406, 
1938.) 

values for/(0), cos mQ and sin mQ will always occur, negative values for 
light flux are not possible. This difficulty is eliminated by combining 
the variable light flux with a constant flux of appropriate magnitude, 
so that the light flux may be positive at all points of passage through 
the system. Also 100% transmission as is indicated by sin mQ for mQ 
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equal to 90° is an evident physical impossibility, and a modulating 

factor is necessary on this account. 

An analysis made with Wente’s instrument when compared with one 
made with an Henrici instrument showed certain discrepancies in magni¬ 
tude of amplitudes. (See Fig. 18, which shows comparative analysis of 
the sound “ou” as in out.) On the basis of time of operation, however, 
this method proved greatly superior. Thirty harmonics using an Hen¬ 
rici instrument is said to require from five to six hours, whereas the same 
results are obtainable by the optical instrument in about lJ/£ minutes. 


Optical Analysis 



11 1 . 1 1 

lull 


11 11 n 1 1 linl - 



Fig. 18. Comparative analyses of the sound ou in out as determined by Henrici 
mechanical and Wente optical harmonic analyzers. ( Montgomery , H. C., Bell 
System Tech. ./., 17, 406, 1938.) 


A combined optical and electronic analyzer is the cathode-ray instru¬ 
ment devised by V. O. Johnson 1 of the Westinghouse Electric & Manu¬ 
facturing Co. In operation, the waveform to be analyzed and the sine 
and cosine factors are supplied electrically, the former from the source 
under study, the latter from a good quality, variable frequency oscil¬ 
lator. The function f(0) is supplied to one pair of plates of a cathode- 
ray oscillograph. The cos ?n$ or the sin md factor in effect is supplied 
to the other pair. Properly adjusted, the trace on the face of the 
cathode-ray tube is a Lissajous figure whose complexity (Fig. 19) reveals 
visually which particular harmonic is under consideration. From the 
areas enclosed within two traces, one can determine the amplitude of 
a harmonic and its phase with regard to the fundamental. When deter¬ 
mining these areas, one must recognize that portions traced counter¬ 
clockwise are positive and that those traced oppositely are negative, or 

Johnson, V. O., Trans. Am. Inst. Elec. Engrs., 60, 1032 (1941). 
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vice versa. The results obtained by this method are said to check well 
with the tabular method. 

A more definitely electronic device is that manufactured by the Gen¬ 
eral Radio Co. It is described as a heterodyne type of vacuum-tube 



Fig. 19. A pair of Lissajous figures for determining a seventh harmonic as obtained 
by V. O. Johnson, using his cathode-ray method. ( Johnson , V. 0., Trans. Am. 
Inst. Elec. Engrs., 60, 1032, 1941.) 

voltmeter (Fig. 20). The manufacturer states, “The output of the local 
oscillator and the whole of the complex waveform to be examined are 
fed to a balanced modulator where their combination produces both the 
sum and the difference frequencies, or side bands, in the output. The 
original of the complex waveform is not passed by the modulator 
intermediate-frequency output transformer, and the local carrier fre¬ 
quency is suppressed in the output because of the two-tube balanced 


Input multiplier 
(1 megohm attenuator) 
Irect / V-1 



conUlnkljeomponenl* ©^ l f ’*A r | 1 l ^e ? l uen^,, 
between 6 & 16,000 w *or calibration 

cycles 



50.000 cycle 
••Mat top" filter 


3 Stage amplifier 



Sldtb.ndi (P+0) md (P-0) C.l»^ 

carrier suppressed W 000 c ^ ,c 7* , (ps 

Calibrated heterodyning oscillator Amount olurrler |U. 

Supplying carrier (P) at frequency lower sideband (P 0 J * 

of 50.000 cycles minus frequency P±2Q, P±3Q. etc. negligible 

of component of "Q" under analysis here 


Fig. 20. Simplified diagram of the General Radio Co. electronic harmonic analyzer. 


modulator employed. The 50-kilocycle component of the upper side 
band, proportional to the voltage of that frequency present in the orig¬ 
inal wave to which the main dial is set, is selected and amplified by the 
intermediate stages.” The current thus amplified is read in a meter. 
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An analysis requires dial adjustments one by one to the harmonic fre¬ 
quencies in the waveform under examination, adjustment with each 
new component to a standard sensitivity for the fundamental, and re¬ 
cording of the meter readings. Only component frequencies and their 
amplitudes are obtained. No phase relations can be determined. The 
voltage uncertainty is said to be within ±5% on all ranges. This method 
is particularly suitable where the complex waveform is available as a 


continuously repeated emf in an electrical circuit. The analysis is then 
but a matter of a few minutes. 

Many other harmonic analyzers are described in the literature. 1 

16. Bettering the Approximation Involved When Only a Finite Num¬ 
ber of Terms of a Fourier Series Are Used. In harmonic analyses, such 
as that carried out above, one makes determinations of coefficients as 
though coefficients for an infinite number of terms were to be used 
when applications were to be made, and then in fact stops with a finite, 
usually rather small, number of terms. A question naturally arises. 
Considering that only a few terms are to be used, would not somewhat 
changed values for the computed coefficients fit the data letter? The 
answer involving least-squares procedure (Chap. XI) states that, given 
that the series is to be a harmonic series even though possessing a finite 
number of terms, the equation yielding the best fit has exactly the co¬ 
efficients given by the standard Fourier analysis. Even if but one sine 
or cosine term is to be used in representing a given function, the best 
coefficient for that term is that specified by Fourier analysis. To illus¬ 
trate, if one should attempt to represent the instantaneous power curve 
of Fig. 6 by a single term such as a 5 sin 50, the best value for a 5 would 
be —5.38, the best equation, should both sin 50 and cos 50 be deter¬ 
mined, would be „ ^ 

y = G.3 sin (50 — 140 ) [G8] 


Obviously, a trigonometric series, containing a finite number of terms 
whose coefficients have been obtained by the Fourier method, can be 
bettered only by increasing the number of terms. 

17. Summary. It is shown in this chapter that any cyclic function of 
an independent variable which is finite, single valued, and possesses 
only a finite number of finite discontinuities, may be represented by an 
infinite trigonometric series known as a Fourier series. It has been 
shown that these series art? always convergent. Series of this type 
when integrated tenn by term are always convergent, though it cannot 
be said generally that the series obtained by differentiation will also 


converge. 

1 Hall, Harry H., J. Acoustics Soc. Am., 8, 257 (1938). A general discussion of 
various types of analyzers is given. 
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With the angle 0 as the independent variable and 0 < 0 < 2tt as the 
range, we have as the most general of Fourier series the whole range 
sine-cosine series 


y 


= f(0) = ~ ^ ^ (dm sin md -f- b m cos md) 

A 


oo 


[i] 


m = 1 


Values for the coefficients are given by 


and 


1 C 2t 

a m = - I y sin md d6 [17] 

7T Jo 

i r 2v 

bo = - / ydd [19] 

TT Jo 


i r 2x 

b m — - I y cos md dO [20] 

7T Jo 


Eq. 1 with coefficients evaluated may be changed to a form which 
is generally more useful for practical purposes, namely 



y = f(0) = ^ A m sin {md + €„,) 

rn= 1 



b 0 ( 7r\ 

= - + 2_j A m C0S l ' m6 + € -n ~ 2 ) 

m = 1 

[6] 

where 


A m = V a n 2 + b m 2 

[7] 

and 


, _ 1 b, n 

e m = tail — 

[8] 


a m 


Still another form, containing the imaginary i, useful in theoretical 
physics, to which Eq. 1 may be converted is 


y 


ao 

= m =“+‘V [(6. - ia m y’" e + (b m + ia m )e~ im0 ] 


[ 11 ] 


ill = 1 


There are two half-range series. With point symmetry for the cyclical 
function about points on the 0-axis at 0 = 0, 7r, 2i r, etc., the coefficients 
of the cosine terms of Eq. 1 including bo become zero and the series 
reduces to the half-range sine series 


oo 


y = fi (0) = a "» sin md 


m = 1 


[29] 
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where 


Oi m 


r 

TT Jo 


f i (0) sin md dd 


[30] 


With line symmetry for the cyclical functions about lines perpendicular 
to the 0-axis at 0 = 0, i r, 2i r, etc., the coefficients of the sine terms of 
Eq. 1 become zero and the series reduces to the half-range cosine series 


oo 



2/ = / 2 (e) = 7 ,° + ^ 0m cos md 

[31] 

of which 

Til — l 


and 

2 c x 

Po = ~ f2(e) dd 

* Jo 

[32] 


2 r x 

& m — - 1 / 2 (0) COS md dd 

* Jo 

[33] 


Series representing y = f(d) may be transformed at once into series 

representing y = / or y = / xy , of which T is a period of 

vibration and X a wavelength, by substituting for 0, (2w/T)t in one case 
and (2tt/\)x in the other case. 

Thus for the former case corresponding to Eqs. 1, 17, 19, 20, 29, 30, 
31, 32, and 33 we have 


y 



2tt 


2tt 

m Y l 


>) = h i + °' m sin ( 

' 7 / 1=1 

“• - 1 /XI') “ in ( 


) +b ' 
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2tt 

cos \ m — t 


[42] 


2x , , 

m — t i at 


[43] 


'• -1 1 ’ (I0 


dt 


[43a] 
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2tt . , 
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[44] 
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= h (|r t) = sin { m y 1 ) 
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4 /- T/2 /2tt 
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2tt 
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[45] 


[4(5] 
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Equations exactly like Eqs. 42 to 48 are obtained when 0 in Eq. 1 


is similarly replaced by 


(t * ' 


X and x replacing T and t. 


For the case of a noneyclical function in which in effect the wavelength 
X extends from x = 0 to x = <*>, the whole-range sine-cosine series trans¬ 
forms into the Fourier integral 


F(x) 


“ 2tX. 



00 


dv I F(p) cos — x) dn 


[58] 


< .V N «0 


Where the function extends indefinitely in both directions, we have 




00 


00 



CO 


dv I F(n) cos v(n — x) dfx 


oo 


~\ — 00 <X < 


[59] 


00 


the right-hand member of which is known as Fourier’s integral. 

Four frequently occurring special cycles consisting of a positive and 
a negative loop yield simplified series. Case I. If the areas of the two 
loops add up to zero the b 0} (3 0 , or b'o term is zero. Case II. If the 
positive loop is asymmetric and the negative loop is a displaced image 
of the positive loop, the series satisfying the function is a whole-range 
sine-cosine series containing odd terms only. Case III. If the positive 
loop is asymmetric and the negative loop possesses point symmetry 
with respect to the positive loop, the series satisfying the function is a 
regular half-range sine series. Case IV. If the positive loop is sym¬ 
metrical and the negative loop possesses point symmetry with respect 
to the positive loop, the series satisfying the function is a half-range 
sine series containing odd terms only. Cosine series may be obtained 
for Cases III and IV if, in effect, the origin is shifted along the 0-axis 
by 7r/2. 

The coefficients for the series terms involve integrations. Often the 
function to be integrated is not expressed mathematically and it is neces¬ 
sary to resort to tabular or mechanical integrations. Tabular integra¬ 
tions as illustrated in Table I are usually time consuming. Further, the 
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coefficients for the higher harmonics tend to become progressively more 
and more uncertain. Mechanical integration, however, once the func¬ 
tion is properly graphed, becomes a simple matter for a device such as 
Henrici’s rolling sphere harmonic analyzer. The time required is very 
much shorter than for the tabular method. Further, it yields coefficients 
for the higher harmonics with approximately the accuracy attained for 
the fundamental. Other devices generally less accurate but much more 
rapid in operation are available. 

Least-squares treatment shows that, if a finite number of terms of a 
Fourier series only are to be used in representing a function, the best 
values for the coefficients are just those occurring in the solution for an 
infinite series. 


PROBLEMS 

1. Determine the whole-range sine-cosine series to represent y = 6- for the range 
0 < 9 < 2tt. 

2. Express the result of Problem 1 as a harmonic series in which relative phases 
of the various harmonics are shown. 

3. In certain amplifications of photoelectric currents the light beam is “chopped” 
regularly to give an illumination E for the time interval 772 and no illumination for 
an equal time interval and then an illumination E once more for the interval 772, etc. 
What is the harmonic series that represents the illumination? 

4. What is the harmonic series that represents a “chopped” illumination such as 
described in the preceding problem except that the illumination, and no illumination 
intervals are 2773 and 773? 

6. Find the half-range sine series for the broken line y = 9 for the range 0 < 9 < 

tt/2, y = 7r — 9 for the range tt/2 < 9 < 3tt/2, and y = — 2ir -f- 9 for the range 

3tt/2 < 0 < 2ir. 

6. Find the half-range cosine series for the broken line y = 9 for the range 

0 < Q < tt/2, y = tt/2 for the range tt/2 < 9 < 3tt/2, and y = 2ir — 9 for the range 

3tt/2 < 9 < 2tt. 

7. Assuming the portion of Fig. 5A for the region 0 < 9 < 2ir to consist of two 
right-angled triangles with 30° as the smallest angle, compute and compare the two 
Fourier series obtained first when the origin is located as shown and second when the 
origin is located instead at 0 = tt. 

8. The cycle of the graph of displacement of a point on a vibrating string shows 
two self symmetrical loops which are symmetrical with respect to a point on the time 
axis. Measurements of displacement at the indicated phase angles give the following 
values: 

Phase angles in 

degrees 5 15 25 35 45 55 65 75 85 

Displacements 

in cm +0.041 -0.013 + 0.05! -0.017 -0.023 +0.125 +0.424 +0.771 +1.001 

Graph the function and make a harmonic analysis. 

9. Compute the fifth harmonic for the data of Table I. 

10. Find the half-range sine series to represent Fig. 2. Follow the suggestion in the 
text by assuming <t> = 0/2. 
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THE NORMAL FREQUENCY DISTRIBUTION 

1. Introduction. The basic problem of every quantitative experiment 
is that of determining directly or indirectly what we call the “true 
value” of a quantity—the period of a pendulum, the normality of a 
solution, etc. Strictly speaking, we can never measure the true value 
of any quantity; we can obtain only an approximation thereto. By 
refining our methods of measurement, we can obtain closer and closer 
approximations, but there is always a limit beyond which refinements 
have not or cannot be made. It is thus desirable to know in any par¬ 
ticular case just what relation the measured value bears to the true value. 
For obtaining this information, a knowledge of the law of frequency 
distribution of measurements is of great value. 

Consider, for example, the measurement of the prism angle, X , of a 
00° prism on a spectrometer with a scale which can be read to 0.001'. It 
will be found that, though all readings are taken with equal care, suc¬ 
cessive measurements will not agree with one another. In a particular 
case, assume values of 


60° 0.320' 

G0° 0.320' 

.318 

.319 

.317 

.322 

.320 

.320 

.321 

.319 

.319 

.321 


to be obtained. Given only this list of values, the question arises, what 
value shall be taken as being probably nearest to the true value. We 
may take the arithmetic mean, X = 'SX/n; the geometric mean, 

X g — V / A r 1 X X 2 -- X n ; the root mean square mean, Xrms = 

V / (A 1 2 -f- X 2 2 + • • • X n 2 )/n; the median, M e , the middlemost value 
when listed in order of magnitude; the mode, M 0 , the value of X which 
occurs most frequently; or any one of a number of other such values. 
Or, with perhaps some slight justification, we might reason that since 
in the past our measurements have usually been higher than those 
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obtained by others, we should regard the smallest value as the best 
approximation to the true value. 

Consider now the frequency distribution of the above series of angle 
measurements, showing how often, relatively, the various actual values 
occur. The plot of Fig. 1 is a very convenient method of presenting an 
over-all view of the spread of values and the general nature of the distri¬ 
bution. It shows, among other things, that the reading 60° 0.320', 
representing the angular interval 60° 0.3195' to 60° 0.3205', is obtained 
four times; and, as indicated by the ratio of the area of the rectangle 



Angle Measurement 


Fig. 1. The frequency distribution for twelve readings of a certain prism angle. 
The least count, the smallest amount by which two measurements can vary and 
still be detected as unequal, is 0.001' in this case. 


centering at 60° 0.320' to the total area under the curve, that the rela¬ 
tive frequency of occurrence of this reading is 

If the number of measurements were increased indefinitely and the 
least count made as small as possible, the distribution curve would appear 
less steplike and in the limit would become smooth. This smooth curve 
Is the infinite parent distribution of the measurements. The observed 
set of twelve measurements may be thought of as a sample set from the 
indefinitely large number of measurements which make up the parent 
distribution. The equation of the parent frequency distribution curve 
Is referred to as the law governing the distribution of the observed 
measurements. Knowing this law, it is possible to arrive at a value 
for the measured quantity which, except for instrumental errors and 
personal idiosyncrasies of the observer, we can justly declare to be the 
most probable value. 

Depending on the assumptions made, several forms of frequency dis¬ 
tribution laws have been obtained. Which is most likely to govern the 
distribution of a proposed set of measurements is generally impossible 
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of prediction in advance. However, the normal distribution law, or, as 
it is sometimes called, the law of errors, seems to fit observed distribu¬ 
tions in a great number of cases. Further, the normal law is one of the 
simplest, containing only one arbitrary constant; and many of the other 
distribution laws reduce to the normal law under suitable limiting con¬ 
ditions. Because of our desire for this simplicity, we often mistakenly 
assume that the normal law governs all distributions of measurements. 
For many distributions, however, this assumption is obviously im¬ 
possible. 

In this chapter we first present Hagen’s derivation of the normal 
distribution law and then explain its physical interpretation. The pro¬ 
cedure of normalization of the law is carried through, and its significance 
in describing probabilities is discussed. The precision indexes associated 
with the normal distribution are then defined and explained. Finally, 
we derive the criterion of least squares, and show that for a distribution 
governed by the normal law, the mean is the most probable value. 

2. Hagen’s Derivation of the Law of Normal Frequency Distribution. 
The normal law may be derived, using various sets of basic assumptions. 
The assumptions used by Hagen seem to simulate physical conditions 
moderately well and to permit of a simple derivation. The derivation 
follows. Hagen assumed (1) that errors unavoidably enter in each of a 
series of measurements of a quantity, (2) that each of these errors may 
be thought of as being composed of a great number of veiy small equal 
elementary errors, and (3) that in any measurement, an elementary 
error is as likely to enter in a positive as in a negative sense. 

To illustrate these assumptions, we shall assume that the arithmetic 
mean, 60° 0.3197', of the measurements reported above is the true value, 
though we shall see that this is not at all necessarily the case. The 
deviation of the first reading from the assumed true value—i.e., the 
assumed error of the first reading—then becomes 0.0003'; that of the 
second reading, 0.0017'; etc. The frequency of occurrence of these errors 
for the group as a whole is shown in Fig. 2. The distribution is identical 
in form with that given in Fig. 1. Each error, in view of the assump¬ 
tions, is to be thought of as due to many minute errors which may be 
associated with the temperatures of the various parts of the spectrom¬ 
eter, irregularities of instrumental calibration, uncertainties of position 
of the eye when reading, peculiar tendencies of the reader, and a host 
of other causes which one may conjure up if so inclined. Each of these 
minute errors, if one is so minded, may be broken up into a number of 
smaller elementary errors. For the purpose of the derivation it is neces¬ 
sary, as stated, to assume that these elementary errors are all of the 
same magnitude and that each occurs as often negatively as positively. 
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The way in which any particular elementary error enters in a particular 
measurement would be, of course, quite beyond our power to control 
or to predict. 

Let 6 be the magnitude of one of the assumed equal elementary 
errors entering a measurement. The probability that any 8 will enter 
positively is 34; the probability that it will enter negatively is also 
34. If there are m of them, the probability that all the 8 's will be 
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Fig. 2. The frequency distribution of the errors of twelve readings of a certain prism 

angle, assuming the arithmetic mean to be the true value. 

positive, thus yielding an error of -\-m8, is evidently (^j • The prob¬ 
ability that all 6’s but one will be positive, and that the resultant 

error is +(m — 2)8, is m [(rxoi • The fact oi 

here because there are m ways in which the combination of errors 
under consideration can take place. Similarly, the probability that 
only (m - 2) 8 ’s will be positive, giving a resultant error of +(m - 4)6 

. m(m - 1) lYlY- 2 / lVl m(m - 0 /l\ m T 

-hr 1 U xy],.,- ir y ’ 


• m appears 


he ccefficien 


of the term 



are seen thus to be the coefficients in the binomial 


expansion of (a + b) m . Table I follows. 

In Fig. 3, the computed probabilities, <ll\ are shown as small rect¬ 
angles, each 26 wide. In the limit, as 5 —» 0, the height of a rectangle 
becomes the ordinate of a point on a smooth curve. This ordinate is 
called a probability coefficient and is defined by 


ill 


r - -i 



Probability of Occurrence 
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TABLE I 


The Relation Between the Component Elementary Errors and the Re¬ 
sultant Errors Occurring in Measurements, and Their Probabilities of 

Occurrence According to Hagen’s Treatment 


Number of 
Elementary Errors 

The Resultant 
Error, x 

Its Probability 
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Negative 
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(m — 2)5 

»(r 
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where dP represents the probability of an error lying between x - YtfLx 
and x + Ysdx. Physically, y is related to P and to x just as a velocity 

is related to distance traversed and to time. 

We seek the equation of a continuous curve which represents the case 
where the elementary error, 5, becomes indefinitely small, and the num¬ 
ber of elementary errors, m , increases without limit. This may be ob¬ 
tained by (1) determining the Ay/Ax between the tops of adjacent ele¬ 
mentary rectangles of Fig. 3; (2) obtaining the corresponding^lim ^ > 

or, dy/dx; and, ( 3 ) integrating dy/dx with respect to x to obtain y = /(x). 
Following this plan and using the points of Fig. 3 corresponding to the 
errors x n +i [ = (m — 2 n — 2 ) 6 ] and x n [= (pi — 2 n) 6 ], we have 

m — n 

Vn -— Vn 

Ay _ y n - y n + i _ n + 1 = _ V_n m 1 

Ax x n — x n _}_i 25 26 n + 1 

Noting, except for the tails, that n » 1, and that for the error x H 

2n = m — ^7 [3] 

we may write, in the limit, for the region where the errors are small in 
comparison with the maximum possible error, i.e., where x « m 5 



The error mb , that occurring when the elementary errors are either all 
positive or all negative, is relatively very large; 5, on the other hand, is 
one-half the minimum variation in errors, and is infinitesimal in com¬ 
parison. The product mb 2 is finite, however, and is of importance in 
the discussion of the law. Customarily the fraction l/m 6 2 is replaced 
by 2 h 2 . The significance of h, which is called the “modulus of precision” 
will be given later. The differential form of Eq. 4 then becomes 


whence, finally, 



[ 5 ] 

[ 0 ] 



THE NORMAL FREQUENCY DISTRIBUTION 

This is the standard form for the normal law of errors, or more appro¬ 
priately and more generally, as will soon appear, the law of the normal 
frequency distribution. 

A plot of Eq. 6 in which x stands for an accidental error 1 of measure¬ 
ment is shown in Fig. 4. In conformity with Fig. 3, the curve has a 
maximum at * = 0, is symmetrical with respect to the y-axis, and 
approaches the z-axis asymptotically at both extremes. Actually, be¬ 
cause of the manner of derivation,‘it occurs that Eq. 6 is only an approxi¬ 
mation to what is called the binomial distribution law in which an 



infinite number of infinitesimal elementary errors occur. The two dis- 

tributions differ most in the regions that are referred to as tails. On a 

percentage basis, the failure to check increases with the magnitude of 
the error. 

Another method of derivation, due to Gauss, starts with the assump¬ 
tion that the most probable approximation to the true value of a quan¬ 
tity of which many determinations have been made with equal precision, 
is the arithmetic mean of those determinations. His procedure leads 
finally to the re'sult obtained by Hagen, namely, Eq. 6. As is to be 
expected, and as will be shown, granted Eq. 6 as a conclusion 

of Hagen’s reasoning, we may deduce Gauss’s assumption as a con¬ 
sequence. 

Although here derived on the basis of errors occurring in a number 
of measurements of a single physical quantity, Eq. 6 is often useful for 
representing other types of frequency distributions. Thus, the frequency 
distribution of the weights of a large number of apples, picked at random, 

1 We refer here only to such errors ns may be classed as accidental. None of the 
types that may be classed as systematic errors, or that are due to theoretical con¬ 
siderations, enter into the law of normal frequency distribution. 
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can also be represented rather closely by it. It is meaningless, of course, 
to speak here of a “true value” for the weight of an apple or of the 
combined influence of a great number of “elementary errors.” It is 
proper, however, to speak of deviations from a mean weight or some 
similar value, caused by variations in such elementary factors as the 
age of the tree, the cultivation it receives, the type of soil, the climate, 
the size and health of the branch, the location of the apple on the branch, 
the amount of surrounding foliage which may cut off sunlight, etc. In 
the discussion to follow, therefore, we refer to .r-values sometimes as 
“errors,” but more often as deviations. 

Frequency distributions are often desired for other purposes than 
those of obtaining “best” values from groups of measurements. A 
knowledge of the distribution of the sizes of a sample group of manu¬ 
factured products tells whether the batch from which the sample 
came is sufficiently close to the size specified, whether proper manufac¬ 
turing conditions are being maintained, etc. A shoe manufacture! 
would want to know the distribution of foot sizes in the population in 
which his products are sold in order to properly apportion his produc¬ 
tion. A botanist would obtain the distribution of sizes of a number of 
samples of a certain plant grown under special conditions and compaie 
it with the distribution of sizes obtained under ordinary conditions to 
see whether or not the special conditions produce a significant change in 
the size of the plant. 

In general, as will be shown in the following chapter, a randomly 
chosen distribution will not follow the normal law. Nevertheless, so 
many distributions do approximate this law, within the limits of 
experimental or sampling error, that the concept of the normal law is 
of great value. We should think of the normal distribution law not as 
one which all types of measurements must obey, but as a simple and 
convenient law applicable to many distributions whose graphs have the 
general shape shown in Fig. 4. 

3. Galton’s Quincunx. Of interest here is Galton’s quincunx, a piece 
of apparatus which is based on Hagen’s assumption that a very large 
number of small elementary errors enter to determine an actual resultant 
error in a measurement. Once set in motion, the quincunx automatically 
yields a binomial frequency distribution which, resembles the normal 
distribution and lends plausibility to Hagen’s method of derivation. In 
design (Fig. 5), as suggested by its name, it is based on an arrangement 
of five pegs, four of which are at the corners of a square, with the fifth 
at the center. Small shot, falling down through the small hole in the 
hopper at the top, receive small sidewise impulses directed with equal 
probability to the right and to the left as they impinge upon the quin- 



154 


THE NORMAL FREQUENCY DISTRIBUTION 


cunx array of pegs, and are finally collected in bins at the bottom. The 
upper boundary of the collected shot approximates a curve of the form 
of Eq. 6. 




Fig. 5. 


Galt on’s quincunx, a device for illustrating the physical basis of the normal 

frequency distribution law. 


4. The Constants h and k of the Equation y = ke~ h °' x \ As shown in 
Fig. 6/1, varying the constant h, keeping k constant, results when 
graphed in a series of curves which differ only in their lateral spreads. 
Similarly, varying k only results in a series of curves which differ, as 
shown in Fig. tiB, only in their vertical extents. Any one curve may be 
obtained from any other by appropriate expansions and contractions 
laterally and vertically. Since a large value for h corresponds to a 
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NORMALIZATION OF THE EQUATION y = he h ' x ‘ 

small spread of measurements, h is appropriately a modulus of precision. 
The significance and the evaluation of k, however, are less evident. 
Instead of considering k itself, consider the significance of Eq. 6 as a 
whole. Assume a group of measurements with least count Ax, whose 
deviations from their mean obey the law of Eq. 6 . Then the probability 
that a randomly chosen measurement has the deviation aq is y iAx; the 
probability that it has the deviation x 2 is y 2 Ax; etc. Further, the prob¬ 
ability that its deviation is either x x or x 2 is (r/i + 2 / 2 )Ax. Thus the 
probability that its deviation lies between - <*> and + «> is Zy Ax. This 
sum contains the y’ s corresponding to all possible x’s between - « and 



Fig. 6. Graphs of y = ke~ h * x2 for varying values of h and k. In A the common value 

for k is 1.00. In B the common value for h is 1.00. 


4 - 00 . Since it is certain that the random deviation concerned lies 
between - 00 and + <*>, XyAx, represented graphically by the area under 
the curve of Fig. 4, must equal unity. As Ax -> 0, we have 

ydx — 1 [7] 


Fig. G shows that for each h el k may be determined to satisfy Eq. 7. 
The procedure follows. 

5. Normalization of the Equation y = he' h 1 . Here, the procedure 
is based upon analytical geometry considerations, though such is not a 
necessity. In Fig. 7 is shown the solid generated by rotating about the 
y .axis the curve representing the positive half of the equation y = 
ke~ h2x \ Let A/2 represent the area in the x-y plane which is bounded 
by the curve and the x- and y- axes, hence also the corresponding area 

in the y-z plane. Then 







[ 8 ] 
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Further, since x and 2 are independent variables, we may write 

dx f e~ h2zi dz 


dx dz [9] 

Viewed geometrically with the aid of Fig. 7, evaluating the double inte- 
gial coriesponds to determining the volume of the solid which is bounded 



-<*/'/ 


e -hHx*+z*) 



Fig. 7. A convenient diagram for use in normalizing the equation y = 


by the .r- 2 , the .r-y, and the y-z planes and the surface obtained by the 
rotation about the y-axis. For the element of volume indicated by abed , 
the common y-ordinate is ke~ h * r ', where r 2 = x 2 + z 2 } and the area of its 
projection on the x-z plane, dS, is (tt/2 )r dr. For the volume, V, there 
follows 

V = Jyds = kJJ dxdz 



[10] 
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The integration is simple. There follow 




A 2 = 4 kV = ~ 

hr 




Since A is to represent a probability of unity, we have 

k = 4 [12] 


and for the normalized equation of the law of normal frequency distribu¬ 
tion 



Here y x is to be viewed as a probability coefficient which, when prop¬ 
erly expressed, has a unit attached. In case x is measured in seconds, 
h and y will be expressed in reciprocal seconds, and y x dx, an element 
of probability, will be a numeric. The subscript x in Eq. 13 has been 
added to distinguish the probability coefficient there considered from 
other different but similar coefficients that will be considered later. 

Whenever it is desired to have the area under the curve represent a 
number of observations, n, we need only set k = nh/yfv so that 



Although its units are the same as those* for y x , y n itself is to be regarded 
as a frequency coefficient. Obviously, to fit the normal law to an ob¬ 
served set of measurements, it is necessary to find the proper value 
of h. 

6. Special Values of x Associated with the Curve y = (h/\Ziv) e~ h2x2 
—Precision Indexes. Four x-values of special significance, usually 
referred to as a group by the name precision indexes , are (1) \/h, the 
reciprocal of the modulus of precision; (2) a, the average deviation; 
(3) <r, the standard deviation; and (4) p , the probable error. They are 
defined with respect to Eq. 13 as follows: 
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1. The quantity \/h is that value of x for which the corresponding 
y-value is 1/e times the maximum y-value; i.e. 


(yx)iih 





It is seen that high values for y 0 and narrow spreads go with high 
values for h. Since precise measurements yield distributions of this 
shape, h is appropriately a modulus of precision as already noted. 

2. The average deviation, a, is defined as the mean deviation with¬ 
out regard to sign. Mathematically 



3. The standard deviation, <r, is defined as the square root of the 
mean squared deviation. In terms of Eq. 13. 



4. The probable error, 
lation 




p, is that value of x which satisfies the re 



The area under the normal curve between the limits p and — p is 
one-half the total area; and the probability of a deviation less than/? 
in absolute value is equal to the probability of a deviation greater 
than p. By means of tables we find p = 0.477//?. 

The relations of the precision indexes to one another for a strictly 
normal distribution are given by 


1 

p : a : a : - = 0.477 

h 


0.564 : 0.707 : 1.000 


[19] 


and approximately by 


1 


p:a:<x:-=3i:4:5:7 


[ 20 ] 


1 It would be more logical to represent the second member of this equation as 
(Ux) 0 / c; but no other value such as o is being used, hence the simplification. 
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The relative positions of the precision indexes on the curve of Eq. 13 
are shown in Fig. 8. The values of the ordinates corresponding to these 
special values of x are also indicated in terms of the maximum ordi¬ 
nate, 2/o- 

It is customary to indicate by a subscript the quantity to which a 
precision index applies. Where, as above, the indexes are obtained for 



0 P a a \/ h 

X 


Fig. 8. A graph of the law of normal frequency distribution, showing the relative 

positions of the precision indexes p, a, a, and 1/A. 


a distribution of z-values, it is proper to write them as p Xf a Xi a x , 
and (l//i) z , and to consider them as applying to the individual z-values 
comprising the distribution. 

7. Tabular Representations for the Normal Curve. The calculation 
of ^/-values corresponding to given x-values in Eq. 13 is somewhat in¬ 
volved. Obviously, a table of corresponding x- and y-values would 
eliminate much computation. However, since the physical nature of x 
and the value of h both change from one distribution to another, such 
a table would, in general, be valid for only one particular distribution. 
If, however, instead of x, we use fix, or x/a, or x/p as the independent 
variable, a single table will cover all cases. Recognizing that for a given 
distribution regardless of whether deviations are expressed in terms of 
x , hx , x/a , x/p or otherwise, the probabilities associated with given 
ranges of measured values must remain invariant, we may write at once 


Vx dx = y hx d(hx) = y x/a d 




[ 21 ] 
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of which y hx , y x/a etc., like y x , represent probability coefficients. For 
the case involving hx as the independent variable, we have, as is evident 

d(hx) , rooi 

2/x = yhx —— = hyhx 

ax 

With the aid of Eq. 22, one may easily obtain a distribution of y x = f(x), 
once given tabulated values of 

yhx = f(hx) = jr; e _A212 [23] 

as in Table I of Appendix 2. To illustrate, the y x corresponding to 
h = 5.0 cm -1 and x = 0.10 cm, is obtained as follows. From the table, 
the value of yhx for hx = 0.50 is seen to be 0.439. Multiplied by h, 

there results 2.20 cm -1 , the desired y x . 

Frequently a normal frequency distribution curve is fitted to observed 
data in order to find the expected probability of occurrence of a 
deviation lying between x\ and xo. For this purpose we desire a conven¬ 
ient method for obtaining the probability, P x , of a deviation lying 
between —a: and +x, for we may then express the probability of a devia¬ 
tion lying between X\ and x<i by one-half of the difference P Xi — Px\- 
The value of P x is represented graphically by the area under the normal 
curve between the limits —x and -\-x, or mathematically, by 



To evaluate P x we may (1) draw the normal curve and measure the 
designated area with a planimeter; ( 2 ) calculate or obtain from table I 
of Appendix 2 a series of ordinates between 0 and x and apply a quad¬ 
rature formula; ( 3 ) express e~ h ' x ' in series form and perform the inte¬ 
gration indicated by Eq. 24 for each term; or, preferably, (4) make use 
of tables giving probability summations. The results obtained for each 
of the first three procedures, showing P x as a function of x, are valid 
for only one distribution. Obviously, a probability table is desired 
whose values are independent of both the nature of .r and the value of h. 
One such is obtained when hx is used as the independent variable. The 
evaluation for the normal law may then be written 


Px = Phx = - 7 = f e ihz) ' d{hx) t 25 ] 

y/Tt J 0 

A table showing Pm as a function of hx such as is found in Table II of 
Appendix 2 applies to all normal distributions. If, for example, foi a 
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distribution where h = 5 cm -1 , we wish to know the probability of a 
positive deviation less than 0.1 cm, we first note that hx = 0.5, and then 
read the desired probability from the table as one-half of P 0 .i C m = Pu, x = 0.5) 
= 0.520 or 0.260. On the other hand, the probability of occurrence 
of a deviation, either positive or negative, less than 0.1 cm is P ( /, x==0 . 5 ), 
or 0.520. 

In practice, a and p are used much more often as precision indexes 
than is l/h. In consequence, values for P x a and P x / p as functions of 
x/a(= hx/ 0.707) and of x/p(= /ix/0.477) are often desired. Such values 
are readily obtainable from the table just referred to. 

Illustrating the use of Table II of Appendix 2 with respect to P x/a , 
consider the following. Given that the standard deviation for the lateral 
deviations of target hits from a central vertical line is 15 inches, and 
that the frequency distribution is normal, what is the expected per¬ 
centage of hits falling within the 15-inch range? What range of devia¬ 
tion will probably include 90% of the hits? Replying to the first ques¬ 
tion, it is apparent that we seek the value of P{ X / a = i>. We first find the 
value of hx{= x/\/2 a) that corresponds to x/a = 1. It is 0.707. 
In the table we find the corresponding P/, x to be 0.683. Obviously 
this is also the desired P (x/<r= d and the percentage is 68.3%. Reply¬ 
ing to the next question, we seek first the hx which yields 90% for the 
corresponding P/, x , and then the corresponding x/<r and x. These values 
in turn are found to be 1.16, 1.64, and 25 inches. 

Similarly, illustrating the use of Table II of Appendix 2 with respect 
to P x /p, consider the following questions. Given that the probable error 
for the masses of bearing balls of a certain group is 15 mg and that the 
distribution is normal, what is the expected percentage of balls whose 
deviations are at least 30 mg or 2 p? What is the minimum deviation 
from the mean mass that will include 99% of the balls? The procedure 
here is veiy similar to that used just above. Replying to the first ques¬ 
tion, we seek the value of P( x / Jt = 2 ). The corresponding hx( = 0A77x/p) 
is 0.954. The corresponding P/, x is 0.823. This is the desired P x/p 
and the answer is unity less 82.3% or 17.7%. Replying to the second 
question, for a P/, x of 99%, the table indicates an hx of 1.82. The corre¬ 
sponding x/p and x are 3.81 and 57 mg. 

8. The Arithmetic Mean of a Set of Measurements. We return now 
to the question raised at the beginning of this chapter: given n measure¬ 
ments of a quantity, X if X 2t - ■ X n , all taken with equal care, what, on 
the basis of the normal frequency distribution, is the most probable 
value of the quantity? As an aid in finding this value, we introduce 
X", an arbitrary function of all the measurements. It may be 
conveniently thought of as a variable pseudo-mean whose value 
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depends on the method of formation. We may, if we wish, define it by 



where m, as a variable, may have any value ranging from 0 to <*>. 
Let x"i, x" 2 , • • -x” n be the deviations of X lf X 2 ,• • -A r n from X". On 
the basis of the previous discussion of the nature and the distribution 
of errors, it is now assumed that the preferred value of X" is that for 
which the corresponding combined probability of simultaneous occur¬ 
rence of x"\, x " 2 , • • • x" n is a maximum. If the set of measurements 
obeys the normal law, the probability of occurrence of the deviation 
x"i, i.e., the deviation lying between x'\ and x'\ + Ax" where Ax" is 
the least count of the set of measurements, is given by 

A P = P(x"i+ax") ~ Px"i — Vx"i Ax" [27] 

Similarly, 

AP^ = yjc" 2 Ax", etc. [28] 

The combined probability of the deviations x"i and x" 2 both occurring 
in the order specified is then given by 

(A 2 P)^„ ^ = A/V', A/V 2 = Vx"i Vx"i (Ax") 2 [29] 

= (Ax „ } 2 [30 ] 

Hence, the condition that the combined probability of occurrence of 
x" lf x" 2 ,- • -x " n should be a maximum may be written as 

(A n P)y u ...y n = (Ax'') n = a maximum [31] 


or, in logarithmic form, as 

h Ax" 

y/ 7r 

The conditions which must be fulfilled in order that Eq. 32 may be 


y — /i 2 Sx" 2 = a maximum [32] 


In(A n P) 


■r",. ••• - l n ( 


true are 


dX 


U 


[ln(A"P) J " li ... *"„] = 0 


dX 


775 [ln(A"P) x " 1 ,...x"„] < 0 



and 


[34] 
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As the first derivative, we have 
-4[ln(A B P)^-^J = — 


dX 



J9 


2*"i £?, + 


• • 


dX" 



= 2/iV'i +*" 2 +- 


[35] 


The step eliminating the derivatives _is a consequence of the definition 
of an x" k , namely that x" k = X k - X" and that accordingly 


dxTk 

dX" 




As the second derivative, we have 
^772 [ln(A n P)^ li ... x »„] 

= -4 [2 h 2 (x'\ + x" 2 + • • •*"„)] = -2 nh 2 [37] 

dX 


Applying the condition of Eqs. 33 and 34 requires that 


and 


x" 1 4“ x "2 + • • ’X n n — 0 
-2 nh 2 < 0 


[38] 

[39] 


It is at once evident that the latter of these_two equations is true and 
that the former fulfills the condition that X" shall be the arithmetic 
mean of the given n measurements. 

The conclusion just derived with the aid of the normal frequency 
distribution law, as noted above, was used by Gauss as the fundamental 
assumption on which his derivation of the law was based. 

Rearrangement of Eq. 32 yields 


0 1 , (h AxV . . . 

2x 2 = In ( —) — a maximum = a minimum 
h 2 \ V 71 '/ 



where now an x represents the deviation of an individual measurement, 
X, from the mean, X. In this form one sees that the assumptions (1) 
that the measurements follow the normal distribution law and (2) that 
the combined probability of occurrence of the observed deviations from 
the mean is a maximum lead to a least value for 2x 2 . This is the basis 
of the well-known principle of least squares. 
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9. Summary. A knowledge of the law of frequency distribution gov¬ 
erning a set of data is often valuable as a means to an end, e.g., in find¬ 
ing the best value of a series of angle measurements, or as an end in 
itself, e.g., in helping a shoe manufacturer to decide how to apportion his 
production. A great number of such laws have been derived. One of 
the simplest and most applicable is the normal distribution law 



Here x represents the deviations of the observed values from their arith¬ 
metic mean; h f the modulus of precision, is a constant whose value 
depends on the precision of the data, i.e., the spread of the observed 
values about their mean; n is an arbitrary constant usually set equal 
to 1 or to the total number of observed a*-values; and y has the nature 
of a frequency coefficient or a probability coefficient, depending on 
whether n equals the number of observed values or unity. 

Special values of x of interest are (1) the arithmetic mean of the 
ar-values, for which the corresponding y x has its maximum value, yo) 
(2) the reciprocal of the modulus of precision, 1/A, whose corresponding 
?/-value is yo/e; (3) the average deviation, a, for which y a = 0.728*/o; 
(4) the standard deviation, a, for which y a = 0.607i/o; and (5) the prob¬ 
able error, p, for which y p = 0.797p 0 . The quantities 1 //*, a, a, and p 
are called precision indexes and are related by the equation 


p : a : (7 : 7 = 0.477 : 0.564 : 0.707 : 1.000 

h 



The quantity P X) defined by 




represents the probability of occurrence of a deviation not greater than 
x in magnitude. The probability of a deviation between and x<i in 
value is then P Xo — P Xr The probable error is that value of x for which 

P p = V>. 

Values of y n in Eq. 14 corresponding to specific .r-values are most 
conveniently obtained from Table I, Appendix 2, showing 
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Values of P x in Eq. 24 corresponding to specific x-values are similarly 
best obtained from Table II, Appendix 2, showing 

Pax = 4 = f hX e~ hV d{hx) [25] 

V ^ Jo 

The assumptions (1) that measurements obey the normal distribu¬ 
tion law and (2) that the combined probability of occurrence of observed 
deviations from the best value is a maximum leads to the conclusions 
(1) that the arithmetic mean of a set of measurements is the best approxi¬ 
mation to the true value of the quantity measured and (2) that the sum 
of the squares of the deviations of the observed values is a minimum 
when the deviations are taken from the mean. Conclusion (2) is the 
basis of the principle of least squares. 


PROBLEMS 

1. Plot, on the same set of coordinate axes, binomial distributions whose succeed¬ 
ing ordinates correspond to succeeding coefficients of (J + ^) 5 and (| -f- J) 11 . 
Make the total widths and the areas included under the two curves the same. 

2 . Plot to scale, on the same set of coordinate axes, two normalized curves such 
that the modulus of precision of one is twice that of the other. 

3 . With the aid of tables, find, for one of the curves of Problem 2, the values of x 
for which P x has in succession the values 0 . 2 , 0.4, 0 . 6 , and 0 . 8 . Draw vertical lines 
on the plot at the appropriate abscissas. 

4. What are the values for yo that correspond to values of 1/h of (a) 2 sec, 
( 6 ) 150 cm/sec, (c) 40 in., (r/) 3 sec/day? 

6. Where l/h is 2 ft and the least count is 1 in., what is the probability that three 
randomly chosen measurements, regardless of the order of their taking, will have 
deviations of 8 in., 16 in., and —4 in.? What, if the order is specified? 

6. Show that the curve of the normal distribution law has inflection points at 
x = ±cr. 

7 . A value which has been quoted for the rest mass of the electron mo is 9.1154 X 
10 - 28(1 ±0.00018) gm, of which ±0.00018 has the significance of a fractional probable 
error and is equal to p m „/tn». On the basis of the above statement, determine the 
probability that the value given is correct (1) to within 0.0005 X 10 -28 gm, (2) to 
within 0.00010 X 10 ~ 28 gm. 

8 . A value quoted for the calcite grating space at 20° C is 3.03560 (1 ± 0.00002) A 
(see Problem 7). On the basis of the above, determine the standard deviation and 
the modulus of precision for the quantity and the probability that the result is cor¬ 
rect to within 2.57<r. 
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THE NORMAL FREQUENCY DISTRIBUTION (< continued) 


1. Introduction. In the preceding chapter we discussed the deriva¬ 
tion and the interpretation of a theoretical frequency distribution, the 
so-called normal distribution 

h 


Vx = 


- 



[ 1 ] 


7r 


It was there noted that any observed set of values, assumed normally 
distributed, is to be considered as a sample set from an infinitely large 
parent group of measurements whose frequency distribution has the form 
of Eq. 1. 

In this chapter we shall describe the relation between the sample and 
the parent distributions in greater detail. With this purpose in mind, 
we discuss first the procedure of fitting the best normal curve to a given 
distribution, and then we develop short methods of finding the mean 
and the precision indexes. Some uses of the precision indexes are de¬ 
scribed, and criteria are obtained for the rejection of observations pos¬ 
sessing unduly large deviations from the mean. Limitations of the noi- 
mal law are then presented, and certain tests for goodness of fit of the 
normal law to an observed distribution are described. 

2. Quantitative Evaluation of Precision Indexes. The process of 
fitting the best normal curve to an observed distribution is, in effect, 
that of determining the most probable distribution of the infinite paient 
group. For this purpose, the calculation of only one constant, the mod¬ 
ulus of precision, /*, is required. 

Given n equally precise measurements of a quantity X\ t X 2 ,' ••A n » 
with deviations x\, X2, • • m x n from the mean A, the assumption is made 
that the desired modulus of precision is the modulus which ascribes to 
the observed data a maximum of probability of occurrence. Assuming 
the normal law, the probability that the readings will occur in the order 

given is 


(A n P) 


■fit X2 


x n 


= A P IX X A P x , X • • • A P Xn 



- h'-Zx 2 


[ 2 ] 


(Ax) n = a maximum 
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or in logarithmic form 

71 

In (A n P) xl ... Xn = n\nh - -\nir - h 2 Xx 2 + n In ( Ax) = a maximum [3] 

Jd 


Differentiating with respect to /?, to obtain the modulus associated with 
the maximum probability of occurrence, yields 


whence 



d_ 

dh 


[In (A n P) Xl ... Xn ] = J 


- 2 hXx 2 = 0 



W 

[5] 

[b] 1 


A second differentiation of Eq. 3 with respect to h yields —nh 2 — 22ar, 
a quantity which is essentially negative and indicates that the relation 
expressed in Eq. 6 corresponds to a condition of maximum probability 
for the given measurements. 

In view of Eq. 6, the most probable values of the precision indexes 
for an individual observation are given by 


and 


* 


1 

' ~ V2h 

p = 0 . 6745(7 = 0.6745 




[7] ‘ 

[ 8 ] 1 





1 Many authors differentiate between the precision indexes l/h, <r, and p computed 
for the individual readings of the sample group and the corresponding precision 
indexes for the infinite parent group. These latter values are assumed to be more 
worth while. That the mean of this latter group shall coincide with that of the 
former group is not to be expected. Consequently the deviations x which have been 
treated above are not deviations from the true value of the quantity measured, i.e., 
the mean of the infinite group. Obviously, could deviations from this unknown 
mean be used in computing for our sample group the values of \/h, a, and p, the 
term Xx 2 would be greater than that actually found. Statistical theory gives for its 
most probable value nX^/in - 1). It follows that the precision indexes then 
obtained are greater than those represented in Eqs. 6, 7, and 8. I hey are obtained, 
in fact, by replacing the n of those equations by n — 1, and are so found in many 
texts. The present authors, however, are deviating from this policy. There are 
three reasons. First, by keeping the forms of Eqs. 6, 7, and 8 as they are, the cor- 
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As precision indexes, p and a are used more often than a. That this 
should be the case, despite the evident greater ease of determining an a, 
seems to be largely due to a discovery by Gauss. He found that p and 
<r, as defined above, were 14% more effective than a, and 9% more effec¬ 
tive than (2r 3 )another possible precision index. Expressed otherwise, 
the p or <j from 100 observations is as precise, relatively, as the a from 
114 similar observations. (See page 196.) Because of the foregoing, we 
shall, for the most part, from now on, ignore a as a precision index. 
Further, when describing precision indexes for quantities, following cus¬ 
tom, we shall ignore \/h also and emphasize only p and <r. 

To fit the normal curve, we need only calculate h and substitute in 


V* = —/= c 

V 7T 


-/i 2 x 2 


if a probability coefficient is desired, or in 


nh 

Vn = “7= e 

V 7T 


-/|2x 2 




if a frequency distribution is desired. In calculating h and the precision 
indexes where n is small, we may conveniently use Eqs. 6 to 9 as they 
stand. Usually, however, 2.r 2 will involve lengthy computations, espe¬ 
cially if X is carried out to more significant figures than are contained 
in the original A-readings. Hence, the use of some short method such 
as that of the following section is advisable as a time saver and as an 

aid in eliminating computational errors. 

3. A Short Method of Computing Means and Precision Indexes. 

To find the mean and o-, say, of the measurements Aj, X 2 r * A r „, we 
first assume an approximate mean, X', having a convenient rounded 
value near that of the true mean, and then deal with the differences 


responding equations relating to the more important precision indexes of means are 

kept simpler. Instead of involving Vn(n - 1), the simpler relations involve n only. 
The second reason is that in practice seldom, if ever, as will be indicated later in this 
chapter, are truly normal frequency distributions encountered, even in the infinite 
parent groups. At the best, then, the precision indexes sought can only be approxi¬ 
mations, and it appears that in reality the expressions involving n only may be as 

significant as those involving \/n(n — 1) instead. The third reason is that even 
for parent groups whose distributions approximate the normal very closely, the 
uncertainties in the precision indexes themselves often exceed the assumed error ue 
to approximating (n — l)/n by unity. 

Nevertheless, for the sake of those who differ, the authors will attempt, througn- 
out this book, to make reference to this footnote wherever the above simplification 

has been mode. 



A SHORT METHOD OF COMPUTING MEANS 


1G9 


Xi — X', X 2 — X',- • -X n — X'. The associated numerics are usually 
small and more or less evenly divided between positive and negative 
values. Procedure is based on the following basic relations: 


x = sx = s[y + (x - xp] = x , + s(x - xp 


= X' + A [111 


n 


n 


/i 


and 


a 2 = 


1iX 2 2(X - X) 2 2(X — X' — A) 


n 


n 


ji 


2(X - X') 2 - 2A2(X - X') + nA 


n 


2(X - 


- x 7 ) 2 _ r s(x - xQ i 2 = 

n In. 


S(X-X ') 2 .2 


n 


- A 2 [12] 


The necessary computations, together with a check to be discussed later, 
are carried through in Table I. To one who has done much computing, 
the smallness of the numbers dealt with makes a considerable appeal. 

Where computed results are matters of concern, it is desirable to have 
checks as insurance against errors. There are two checks possible for 
the mean, X. One consists in determining actual values for the devia¬ 
tions X — X and then noting whether or not the sum of the positive 
deviations equals the sum of the negative deviations. The other con¬ 
sists in selecting a new X' and proceeding according to Eq. 11, taking 
care not to use computations made use of in the original calculation. 
The second method is likely to be the shorter if the value of the mean 
is carried to a greater number of significant figures than the original 
measured values. Neither of these checks need be made in case one 
has determined the <r and wishes to insure against error there also, since 
certain checks for a involve a simultaneous check for X. 

Two procedures for checking a will be cited. One is based on the 
defining relation, Eq. 12, which by simple expansion yields 

^ _ ax - nr „ z*! _ + [13) 

n n n n 


This equation does not involve summations previously made, and there¬ 
fore can satisfy as a check. The summation SX 2 will, however, gener¬ 
ally involve uncomfortably large numbers. Procedure for the second 
check consists in selecting a new convenient X' and proceeding as in 
Eq. 12. This method, which is illustrated in Table I, is likely to prove 
much the shorter. The reader who doubts this assertion is invited to 
make the test, using Eq. 13. 



170 


THE NORMAL FREQUENCY DISTRIBUTION 


When calculating a for a set of positive and negative values whose 
mean is nearly zero, the advantages of using Eq. 12 rather than Eq. 13 
generally disappear. Note that if X' is taken as zero Eqs. 12 and 13 
become identical, so that only the second of the two checks for a men¬ 
tioned above can be used. 

TABLE I 

Illustrating a Short Method for Computing X and a , Together with a 
Convenient Check. The Frequency of Occurrence of the Observed Values 

of X is Given by / 



25 
.26 

127 

128 

129 

130 

131 

132 


-3 

-2 

-1 

0 

1 


= 128 


- A" \f(X -X')\f(X - X ') 


-6 

-6 

-9 

0 

11 

14 



18 

12 

9 

0 

11 

28 

18 

16 


112 



-4 

-3 

-2 

-1 

0 

1 

2 

3 


X' = 129 


- X' \f(X - X') f(X - X') 2 


-8 

-9 

-18 

-15 

0 

7 

4 

3 


32 

27 

36 

15 

0 

7 

8 
9 



U = 0.28 

128 + 0.28 = 128.28 
Vtt ~ (0.28) 2 = 2.16 
1.47 

0.675 X 1.47 = 0.99 


= -0.72 

129 - 0.72 = 128.28 
w - (0.72) 2 = 2.16 
1.47 

0.675 X 1.47 = 0.99 


Accepted values: -V = 128.3; a = 1.5; /> = 1.0. 

4. Chauvenet’s Criterion. Occasionally, in a series of readings, one 
or two values occur which differ considerably from the series as a whole. 

V 

Though we might normally expect such widely divergent values to occur 
once, say, on the average in 100 readings, it is quite possible for that 
once to occur in a group of 10 or of only 5 measurements. In such a 
case, the influence of this divergent reading on the magnitude of the 
mean is disproportionately large, and it is generally conceded that the 
mean obtained would be closer to the true value if this reading were 
rejected. There is no suggestion in the criterion that a gross error has 
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been made in taking a reading which it rejects, although it is very pos¬ 
sible that such is the explanation for the deviation. 

Rejection of a given reading of a series on the basis of a hunch is not 
satisfactory, and a criterion of rejection is desirable. Of the several 
which have been developed, that due to Chauvenet seems most gener¬ 
ally accepted. In words, this criterion states that any reading of a 
series of n readings shall be rejected when the magnitude of its devia¬ 
tion from the mean of the series is such that the probability of occur¬ 
rence of all deviations that large or larger does not exceed 1/2 n. Ex¬ 
pressed partly in equation form, it states that if the deviation x of a 
reading from the mean is greater than the deviation x, where x is de¬ 
fined by 

1 


h r +x 

— Pz = l — —j= / 

V 7T J-x 


-h*x°- 


dx — 


2 n 


[14] 


the reading shall be rejected. To illustrate, in a series of ten readings 
whose probable error is p x { — 0A77/h x ), a reading shall be rejected if 
its deviation from the mean is greater than 2.9 lp x (see Table III, Appen¬ 
dix 2). The probability of occurrence of all deviations as great or 
greater is then less than 1/20. For 20 readings, the value of x is 3.32p x . 
The variation of x with n is shown in Table III, Appendix 2. 

If, after a reading has been rejected in accordance with Chauvenet’s 
criterion, it is felt that a second reading is also too divergent to retain, 
it too should be subjected to the criterion, with the understanding that 
the reading already rejected is no longer a member of the series and the 
new mean concerns the n — 1 remaining measurements. Ihis pro¬ 
cedure may be repeated until it is found that no values lie outside the 
limits set by Eq. 14. 

6. Limitations of the Normal Law. It is blindly assumed by many 
that the vast majority of frequency distributions obey the normal law. 
There are many reasons why such should not be the case. We shall 
discuss certain of them in some detail. 


1. The normal distribution is symmetrical—equal positive and 
negative deviations between limits from the mean are equally likely 
to occur. Few observed distributions are perfectly symmetrical, how¬ 
ever, and numerous distributions show a decided preponderance of 
values either greater or less than the mean (Tig. 1). Such distribu¬ 
tions are called skewed—negatively if the majority of the observa¬ 
tions exceed the mean, and positively for the opposite condition. 

2. The normal law permits variations from —« to +«> ; i.e., it 
assigns a probability greater than zero to every finite deviation from 
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the mean. Hence, such distributions as that of the speeds of mole¬ 
cules of a gas at a given temperature (Fig. 1) cannot be represented 
by the normal law since it is meaningless to speak of negative speeds. 



0 1-=^_I_I_I_I_I_I_I_I_I -r_l 

0 200 400 600 800 1C00 


Speeds in Meters per Second 

Fig. 1. The non-normal distribution of the speeds of oxygen molecules at 0° C. 

3. The normal curve has only one maximum ordinate, at the mean 
value. Some distributions, however, have more than one maximum 
(Fig. 2) and cannot be normal. 

4. Let us assume, despite the three limitations stated, that a par¬ 
ticular distribution, say that of the diameters, d, of a group of bearing 



Fig. 2. A non-normal distribution with more than one maximum ordinate, showing 
the probability of finding a pendulum bob at different, displacements from its equi¬ 
librium position for a given amplitude of vibration. ( University of Pittsburgh 
Atomic Physics, 2nd Ed., p. 165, New York, John Wiley & Sons, Inc., 1937.) 

balls, obeys the normal law, at least to the extent of the balls whose 
diameters fall between d + 5 p,i and d — 5p,/. Then it necessarily 
follows that if all the balls are truly spherical and of equal density, 
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the distributions of their masses, i.e., of the (d 3 ) of the bearing balls 
cannot obey the law. Consider three hypothetical balls, A, B, and 
C, with diameters equal to the mean diameter, d, the mean diameter 
minus the probable error of the distribution, d — pd , and the mean 
diameter plus the probable error, d + pd, respectively (Fig. SA). 
Since the diameter distribution of the group of balls is assumed 
normal, A, B, and C divide them into four equal subgroups—those 
having diameters less than B, those having diameters between A and 
B, etc. Assuming equal density and truly spherical shape for all, A , 
B , and C again divide them into the same four equal subgroups on 



Fig. 3. Distributions of (A) the diameters and (B) the masses of a group of bearing 

balls. If A is assumed normal, B is necessarily skewed. 


the basis of mass also; i.e., all balls having diameters less than B also 
have masses less than B, etc. Hence, if the mass distribution is to 
be normal, ball A should have the mean mass, and B and C should 
have masses respectively less than and greater than the mean by an 
amount equal to the probable error of the mass distribution. How¬ 
ever, the masses of A, B , and C are bd 3 , bid — p ( i) 3 , and b(d -f- Pd) 6 , 
respectively, where b is an appropriate constant, and it is seen that 
the mass difference between A and B is not equal to the mass differ¬ 
ence between A and C (Fig. SB). Thus, if the diameter distribution 
is normal, the mass distribution is skewed and hence nonnormal. 

By similar reasoning it is seen that distributions of the surface areas 
involving d 2 , the moments of inertia involving d°, the values of 1/d, 
1/d 2 , etc., for the group are also nonnormal if the d-distribution is as¬ 
sumed normal. Since the a priori probability of normality for the dis¬ 
tribution of d is equal to that for d 2 , d 3 , d H , etc., the probability of 
any one obeying the normal law strictly is effectively zero. 

Further evidence as to the nonuniversality of the normal law even 
for ordinary distributions is furnished by the large number of statistical 
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distribution laws in use for different purposes. Fry 1 lists eight types, 
some of which cover several subtypes. Those named in addition to the 
Normal law are the Poisson law, the Binomial law, Pearson Types I, 
II, III, and IV, and the Gram Charlier series. 

As such nonnormal distributions of considerable interest in present- 
day research, we have the Poisson distribution, its integral, and its 
derivative. The equation for the law itself is 



of which P TliX represents, for a random distribution of events in a lim¬ 
ited range of the variable x, the probability that n events will occur in 
the interval x, a the average interval of x between events, and accord¬ 
ingly x/a the expected number of events in the interval x. For the 
case of n = 0, or no events occurring in the interval, Eq. 15 reduces to 

Pu.idx = e~ x,a dx [16] 

and, the rate of change of P 0iX with respect to x, to 



For the probability, however, that n or more events will occur in the 
interval x , P >n ,x, we have the summation 

oo 

P>n.x=J2 Pm * [18] 

m = n 

The last equation represents, for example, the probability distribution 
of concern when one tries to correlate the visual responses with the 
quanta of radiant energy that are absorbed by the visual fluid of the 
retina during brief flashes of light received by the eye. It has been 
used by Hecht 2 and his co-workers in a study of the operation of visual 
mechanisms at the threshold of vision. (See Fig. 14, Chap. II.) 

Similarly, — dP 0 , x /dx of Eq. 17 represents, for the emission of 
a-particles from a radioactive specimen, for example, the frequency dis¬ 
tribution for time intervals between successive a-particle emissions. 
Fig. 4 represents data of this nature obtained bv Halliday. 3 Offhand, 

1 Fry, Thornton C., Probability and Its Engineering Uses , New York, D. Van 

Nostrand Company, Inc., 1928. 

2 Hecht, S., Shaler, S., Pirenne, M. H., Science , 93, 585 (1941). 

3 Halliday, D., Ph.D. thesis, University of Pittsburgh, 1941. 
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on the mere basis of randomness, one might be inclined to assume that 
the normal frequency distribution or a close approximation to it would 
apply there. Such, however, is far from the case. 



0 2.0 4.0 6.0 

Pulse Interval in Sec. 

Fig. 4. The Poisson distribution of Eq. 17 as represented by the frequency distri¬ 
bution of time intervals between successive receptions of a-particles from a radio¬ 
active source, as obtained by D. Halliday, who measured 3133 pulse intervals. 
The horizontal portions of the broken line represent observed probabilities for 
half-second intervals expressed in terms of reciprocal seconds. The unbroken line 
represents the expectation according to Eq. 17 for a mean interval of 1.169 sec. 

6. Justification for Assuming the Normal Law. In view of the above 
limitations, one must consider a new situation carefully before ever 
assuming that the normal distribution law applies to a series of measured 
values that has been obtained. But now, having concluded in a partic¬ 
ular case that the normal distribution law or a close approximation is 
reasonable, what shall be done? Let us examine more closely what is 
meant by the statement that the normal law governs a given distribu¬ 
tion. We mean by this statement that as the number of observations 
included in the sample distribution increases, the probabilities of occur- 
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rence of deviations from the mean approach ever more closely the values 
predicted by Eq. 1. An actual sample distribution with a finite number 
of observations never indicates such predicted probabilities. Instead, 
it may be quite skewed, or even two-peaked, and still the infinite parent 
distribution might conform with the normal law. In such cases the 
deviations from normality would disappear if it were possible or prac¬ 
tical to add a sufficiently great number of values. 

Referring to limitation 1 above, a distribution of a finite number of 
readings need not be perfectly symmetrical to be considered normal. 



.68 .70 .72 .74 .76 


Wavelength in Angstroms 

Fig. 5. The Compton effect, an illustration of a two-maximum distribution result¬ 
ing from the inclusions of two physically separate, but not separated, photon 
distributions. Graph shows unmodified, P, and shifted, S, Mo Ka radiation 
scattered by carbon. ( Compton , A. //., P/it/s. Rev., 21, 715, and 22, 409, 1923.) 

Conversely, it is admitted that the infinite parent distribution corre¬ 
sponding to an observed apparently normal distribution may be non- 
normal. The same argument applies to limitation 4. It happens, 
especially when the precision indexes are relatively small, that the 
distributions of such related things as the diameters, areas, masses, etc., 
of a group of bearing balls say, may all be effectively normal, even 
though each distribution is somewhat skewed, and even though only 
one of the related infinite parent distributions can possibly be normal, 
even for a restricted range. 

Limitation 3 is not an important one, since relatively few distributions 
have more than one maximum ordinate, and, as stated above, some 
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two-peaked distributions may actually be samples from infinite parent 
distributions that are normal. However, when the parent distribution 
follows a nonnormal law, proper tests, such as the chi-square test to be 
discussed later, may disclose this fact and thus prevent drawing false 
conclusions by assuming normality. It is interesting that in some cases 
two maxima are obtained as a result of the inclusion in a single distri¬ 
bution of two sets of dissimilar values, each of which yields a distribu¬ 
tion with one peak normally when taken alone (Fig. 5). 

Despite its limitations, the normal law, in addition to being capable 
of representing distributions that are believed to be normal, is also 
capable of representing sufficiently well many distributions which, from 
a priori consideration, are known to be nonnormal. Adding to this the 
fact that the normal curve is the simplest to fit, we feel justified in adopt¬ 
ing the normal law where skewness, flatness, and other characteristics 
do not cause too serious deviations from the normal distribution. 

At any rate, for one reason or another, it is customary to assume 
that the measurements of a quantity follow the normal distribution 
law when the least count is small in comparison with the variations from 
the mean and the distribution is not too obviously nonnormal. On this 
basis, a considerable superstructure of treatment of data has been 
founded, including that in the succeeding chapters of this book. 

7. Qualitative Tests for the Normal Distribution. Tests for applica¬ 
bility of the normal law may be classed as either quantitative or quali¬ 
tative. The former are the more definite in their interpretations, but 
they are rather involved and tedious to carry through. The qualitative 
tests are simple, but often difficult to interpret. They are of value, 
however, in exposing distributions which deviate greatly from the 
normal. Two tests will be described: (1) superposing the normal curve, 
and (2) plotting on probability paper. 

(a) Superposing the Normal Curve. A good idea of the normality of 
a distribution may be obtained by superposing on the graph of observed 
values the computed normal distribution which best fits. For the 
demonstration of how this may be done, we use data by Birge. 1 See 
Table II and Fig. 6. 

Normal procedure, described earlier in this chapter, leads to 

a = 3.60 X 10“ 3 m p [19] 

I = 5.09 X 10- 3 m M [20] 

1 Birge, R. J., Phys. Rev., 40, 207 (1932). The data of the table were reported to 
the authors by private correspondence. 
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and for the 500 observations 

residuals _ 0.0386 2 

y n = 500 residuals X y x = 55.4——~-- e (io-3m/i)2 z [21] 

10 m/i 

TABLE II 

Data by Birge 1 Showing, for 500 Observations of a Spectral Line, the 

Frequency of Occurrence of Various Residuals, x 


By chance the mean was such that all residuals could be expressed precisely in terms 
of a tenth of the least count, 0.0010 m/i, of his instrument. 



Observed 



Computed 


x in 

10 -3 m n 

No. of 
residuals 

x in 

10~ 3 m/i 

No. of 
residuals 

hx 

Vhx 

x in 

10 -3 m/i 

Un in 
residuals 

10 -3 m/i 

+0.1 

62 

- 0.9 

53 

ra 

0.5642 

0.00 

55.4 

1.1 

41 

- 1.9 

52 


.5420 


53.2 

2.1 

45 

- 2.9 

30 

iifl 

.4808 


47.2 

3.1 

44 

- 3.9 

31 

0.6 

. 3936 

3.05 

38.6 

4.1 

34 

- 4.9 

22 

0.8 

. 2975 

4.07 

29.2 

5.1 

20 

- 5.9 

21 

1.0 

. 2076 

5.09 

20.4 

6.1 

16 

- 6.9 

11 

1.2 

.1336 

6.11 

13.1 

7.1 

3 

- 7.9 

1 

1.4 

.0794 

7.13 

7.8 

8.1 

4 

- 8.9 

4 

1.6 

.0436 

8.14 

4.3 

9.1 

3 

- 9.9 

1 

1.8 

.0221 

9.16 

2.2 

10.1 

1 

-10.9 

0 

2.0 

.0104 

10.18 

1.0 

11.1 

1 

-11.9 

0 

2.2 

.0044 

11.20 

0.4 


Continuing, we may compute values directly, using Eq. 21 or make 
use of Table I of Appendix 2, for whose use residuals must be expressed 
in terms of 1 /h or as hx. For hx = 1, i.e., for x equal to 1 /h or 5.09 X 
10” 3 m/i, we obtain for the relative probability coefficient, ijhx, the value 
0.2076. From this in accord with Eq. 22 of Chapter VI, namely 



d{hx) 

dx 




we obtain, as a corresponding value for y nt 



500 residuals__ 

-^-0.2076 

5.09 X 10“ 3 m/i 


= 98.2 


residuals 

10“ 3 m m 


0.2076 


% 


20.4 


residuals 
10 -3 mg 



1 Idem. 
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This value plotted in Fig. 6 at x = +5.09 X 10~ 3 m/z and x = —5.09 
X 10 -3 m/z yields two points of the desired superposed normal frequency 
curve for that graph. Other points may be obtained by seeking simi¬ 
larly (the last half of Table II) values of yh x corresponding to hx values, 
such as 0.0, 0.2, 0.4- • *1.2, 1.4, etc. In all cases the factor 98.2 
residuals/10 “ 3 m/z serves in obtaining the appropriate y n . 

That the superposed curve of Fig. 6 fits well is evident. The ensemble 
of data, as shown by figure and data, is thought, in comparison with 



-12 -8 -4 0 4 8 12 

Residuals, x, in 10 3 w/z 


Fig. 6. Graph showing the frequency distribution of the residuals for 500 observa¬ 
tions of a spectral line as obtained by Birge (Table II), and the superposition of the 
best fitting normal frequency curve. 


other experimental data, to conform to an unusually high degree with 
the normal distribution curve. 

(6) Plotting the Ogive Curve. An alternate method of plotting a distri¬ 
bution curve, Galton’s ogive curve, is shown in Fig. 7. In this curve, 
the number (or percentage) of occurrences of magnitudes either less or 
greater than x is shown as a function of x. Plotting the normal curve in 
this manner would be equivalent to plotting, as a function of x, the 
integral Y lf where 

y, = f y* = f' e ~ hV dx [ 24 1 

or, of course, Y 2 where 

y 2 = I Ijxdx = l — Yi 


[25] 
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Distribution data, however, are frequently presented in the form of 
finite values of AY to correspond to finite increments of x, Ax , which 
are usually constant throughout. We then use the summations 


and 




Yin ~ ^ y,n Arc [26] 

m= 1 

N 

Y2 n = ^2 Vm Ax 
m = n + 1 



Galton’s ogive curve for the distribution of Table II. All of the plotted 
points should be shifted to the right by 0.5 X 10 3 mu. 


in which Y Xn and Y 2n represent numbers of readings. They are usually 
plotted as functions of x my or mAx. Often in tabulations, the values 
listed for the independent variable are central values for the succeeding 
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least-count intervals. To secure passage of the curve through the zero- 
residual 50%-frequency point for a normal distribution, Y ln and Y 2n 
may be plotted as functions of x -f- Ax/2 and x — Ax/2. 

Though the ogive curve possesses some advantages, it is hardly suit- 



Fig. 8. Graph of frequency distribution of Table II plotted on probability paper. 

All of the plotted points should be shifted to the right by 0.5 X 10~ 3 my. 

able as a test for normality, since generally departures from normality 
are concealed rather than exposed. If, however, the data are plotted 
on so-called probability paper rather than on rectangular coordinate 
paper, the resultant curve possesses all the advantages of the ogive curve 
and in addition provides a convenient test for normality. 

On probability paper the scale showing the number of occurrences, 
expressed as a percentage of the total number of occurrences, is dis¬ 
torted so that the distances from 50% to all other percentages are 
proportional to the corresponding values of x/a. The scale is S 3 r m- 
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metrical about the 50% coordinate line, and the integrals Y x and Y 2 
or the summations Y ln and Y 2n , in ease the data follow the normal dis¬ 
tribution law, plotted as functions of x on such coordinates yield straight 
lines. Hence, a plot showing the relative numbers of observations hav¬ 
ing values less than (or greater than) x, as a function of x, will deviate 
from a straight line if the distribution deviates from the normal. Fig. 8 
shows the application of this test for normality to the data of Table II. 
Deviations from normality are revealed though perhaps not as clearly 
as in Fig. G. However, insofar as ease and time of construction are 
concerned, this method of testing is much the superior. 

8. Quantitative Tests for Deviations from Assumed Distributions. 
When a distribution of data is believed, for theoretical reasons or other¬ 
wise, to follow some recognized law of which there are many, it may be 
judged by its closeness of fit to an equation following that law. Often, 
however, many distributions are without theoretical or even empirical 
backing. Then particularly the deviation from an assumed normal dis¬ 
tribution may be sought. There are two tests known as skewness, 
represented in magnitude bv y/0u and flatness, represented in magni¬ 
tude by 02 , which are used to indicate deviations from the normal fre¬ 
quency curve. One test, the chi square, \ 2 , may be used whatever the 
distribution. The chi-square test is much more important and much 
more used than the other tests. 

Skewness, or asymmetry with respect to the distribution about the 
mean of the observed values, obviously cannot be revealed by the sum 
of the deviations from the mean, for that is zero by definition, nor by. 
the sum of the squares of such deviations or of such deviations raised 
to an even power since in such squares or even powers there are no 
distinctions between positive and negative deviations. The sums of 
odd powers, however, do make such distinctions and will indicate asym¬ 
metries. Arbitrarily, the sum of the third powers of deviations expressed 
in terms of the standard deviation a in each instance is used. The 
defining equation used is 

2(X —X ) 3 




In case the data are represented by a curve which has been drawn, the 
following equation may be used instead. 



[ 29 ] 
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Obviously \/^i is zero for a strictly normal distribution. How signifi¬ 
cant any particular computed value may be is only comprehended by 
determining values for various asymmetric distributions. That for the 
distribution of Table I is -f-0.013; that for the molecular speeds of the 
molecules of a gas (Fig. 1) is about 21. 

Flatness, the distortion represented in Fig. 9, on the other hand ob¬ 
viously cannot be represented quantitatively by any odd power summa¬ 
tion. Nor will a second power summation of deviations expressed in 
terms of the standard deviation suffice since when so expressed all such 
summations, however flat or skewed, yield a by definition. A fourth 
power summation will nevertheless show 



for graphed data. 

For a normal distribution fi 2 is 3. Evidently distributions may be 
more flat or less flat than that which is normal. Owing to the increased 
effectiveness of large values of y accompanying large values for x in 
yielding large values for a fourth power summation, it is evident that 
the 0 2 for curve B of Fig. 9 will be less than 3. 

Differing, as already noted from the two tests just described, the 
chi-square test may be applied to determine the deviation of an actual 
distribution from any assumed law for the infinite parent distribution. 
In this case, one considers the probability that a random sample, taken 
from the infinite parent, shall differ from the assumed law by the amount 
found. Though some prefer 0.05 as the limiting probability, it is gen¬ 
erally held that a sample is satisfactory if the probability of its occur¬ 
rence is 0.01 or greater. 

The function x 2 , as defined by Pearson, the originator of the test, is 
based on a comparison of observed, f a , with expected, f C} frequencies of 
occurrence of individual readings, and is given by 
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In the application of Eq. 32, it is usual to array the observed measure¬ 
ments in groups, to each of which a certain specified range is assigned. 
Thus arranged, the number included in any one group is taken as the 
observed frequency of occurrence for the corresponding group range. 
The ranges for the various groups of a distribution need not be the same. 

Once x 2 has been obtained for a particular set of data, it remains to 
determine what the probability of its occurrence shall be. For this 



Fig. 10. Showing chi-square probability, P x i, for goodness of fit of a sample dis¬ 
tribution as a function of x 2 and of n', the number of groups of data less the number 
of imposed conditions. 


purpose Pearson 1 has computed extended tables of probability of occur¬ 
rence, which depend not only on x 2 but also on n', the number of groups 
selected less the number of imposed conditions. 2 One imposed condition 
is that the total number of items entering x 2 must equal the number 
entering the various groups. Other conditions sometimes imposed are 
those ascribing to the infinite parent a distribution described by con¬ 
stants, in the normal case, the X and a determined from the sample. In 


this case n' becomes three less than the number of groups. Sometimes 
still other conditions are specified and should be taken into account. A 


graph giving chi-square probabilities as a function of 


X 2 and n' is given 


1 Pearson. K., Trans. Am. Math. Soc., 31, 133 (1929). 

2 Fry, Thornton C., Probability and Its Engineering Uses, p. 294, 
I). Van Nostrum! Company, Inc., 1928. 
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in Fig. 10. (See also Table IV of Appendix 2.) Application to the velocity 
of light measurements of Michelson, Pease, and Pearson 1 is shown in 
Table III. On the assumption that the infinite parent distribution is 

TABLE III 

Application of the Chi-Square Test to the Velocity of Light 
Measurements of Michelson, Pease, and Pearson 

From 233 determinations a weighted average velocity of light of 299,773.85 km/sec 
was obtained; c' represents the excess of a measured velocity over 299,000 km/sec. 
A frequency, f 0 , for a specified range represents the number of determinations 
falling^vithin the range, and f c represents the number expected on the basis of the 
given X and of a <r of 14.7 km/sec. (The present authors are greatly indebted to 
Dr. E. Q. Adams who pointed out that the procedure of the first printing, wherein 
fo was taken as a sum of weights, was in error, and who has supplied the material 
here presented). 


Range of c' 
in km/sec. 






0.08 


51-55 

56-60 

61-65 

66-70 

71-75 

76-80 

81-85 

86-90 

91-95 

96-00 

801-05 

06-10 

>810 


8 

17 

23 

29 

45 

40 

17 

16 

10 


10.42 
16.24 
22.60 
28.06 
31.09 
30.73 
27.11 
21.37 
14.99 
9.39 
5.27 
2.62 
1.86 


19.14 


+ 2.42 

- 0.76 

- 0.40 

- 0.94 
-13.91 

- 9.27 
+ 10.11 
+ 5.37 
+ 4.99 
+ 4.39 
+ 3.27 

- 0.38 

- 2.14 


+5.14 


0.56 

0.04 

0.01 

0.03 

6.23 

2.80 

3.78 

1.35 

1.66 

2.06 

2.03 

0.05 

2.46 


1.38 


233 


233 


= 29.10 18.52 


For x 2 = 29.10 and n' = 13, /'x 2 = 0.005. For x 2 = 18.52 and n ' = 8, 1\ 2 = 0.018. 


normal, the value computed for P x 2 indicates a rather small probability, 
0.005, that another similar set taken at random would deviate as much 
or more from a normal distribution. However, if the grouping, which 
is entirely arbitrary, is changed by collecting the three lowest and the 
four highest groups of the table into two larger groups, as indicated by 
1 Michelson, A. A., Pease, F. G., Pearson, F., Aslrophya. J., 82, 56 (1935). 
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the brackets, a recognized procedure where the n’s of adjacent groups 
are small, the computed value for P x 2 is larger, about 0.018. On the 
other hand, Fig. 11, in which summations of weights rather than num¬ 
bers of determinations are graphed, suggests that these low probabilities 
may indicate that the present distribution has a flatness (kurtosis), /3 2 , 
loss than 3, as has Pearsons’ Type VII distribution. Obviously, these 
measurements are much leas normally distributed than are Birge’s spec¬ 
tral line measurements. (Fig. 6 and Table II.) 



Fig. 11. Distribution of measurements of the velocity of light made by Michelson, 
Pease, and Pearson (see Table III) grouped for velocity intervals of 5 km/sec. 
The broken line represents actual measurements. The smooth curve represents 
the distribution expected had the measurements followed the normal law. 


9. Summary. The methods for the quantitative evaluations of h t 
a, p , and a are described in Eqs. 6 to 9. 

A short method for computing a mean X and the precision index o 
for a set of n readings consists in assuming an approximate mean, X 
and then applying the two following equations: 


x - y + ~ 


[ii] 


n 


_ X(X - X') 2 _ p(X - X') l 

n Ini 


[ 12 ] 


Chauvenet’s criterion, intended to eliminate from a set of readings 
the effect due to single readings exerting unduly large effects on the means, 
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states that a reading should be rejected when it yields a deviation from 
the mean such that the probability of occurrence of deviations of that 
magnitude and greater is less than 1/2 n, where n is the number of 
readings. With x as the limiting minimum deviation for rejection, the 
criterion takes the form 



The limitation of the normal distribution law is discussed in some 
detail, but it is indicated that it is customary to assume that most sets 
of measurements follow that law and that a considerable superstructure 
of precision treatment of data has been built upon it. 

Qualitative and quantitative tests for the goodness of fit of the normal 
distribution law are described. These included (1) superposing the best 
normal distribution curve, (2) plotting the ogive curve on ordinary cross- 
section and on probability paper, (3) computing skewness and flatness, 
and (4) applying the chi-square test. Chi square, x“, is given by 



(fo - fc) 2 
^ fc 



of which f 0 and f c are observed and expected frequencies of occurrence 
of values as grouped about arbitrarily chosen mean values. With x 2 
computed, one seeks, from a table or from Fig. 10, a probability of occur¬ 
rence, P x2 , of the given set of readings as a function of x 2 and n' the 
number of groups of readings less the number of imposed conditions. A 
P X 2 of 0.01 or more is usually considered satisfactory as a probability. 


PROBLEMS 


1. Find approximate values of p, a, <r, and l//i for the data of Fig. 1, Chapter VI. 

2. Given that the times recorded by 30 observers as the interval for a certain 
phenomenon were distributed as follows: 


3 observers rec( 


rded 32.0 sec 


7 

12 

6 

6 

1 

1 


32.2 “ 

32.3 “ 

32.4 “ 

32.5 “ 

32.6 “ 
33.0 “ 


Compute the mean, p, a, a, and l/h. Should the last recorded observation be 
eliminated? 

3. Plot the data of Problem 2 and draw on the same sheet the curve of the normal 
distribution law which has the same modulus of precision as that computed from the 
data. 
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4. Given that the distribution of diameters, D f about their mean, Do, for a set of 
bearing bails, all of the same density, is 



- D e -ftpg(Z>-Z> 0 )g 

Vtt 


show that the distribution of their volumes, V , about the volume, Vo of a ball whose 
diameter is Do is given to a first approximation by 


yv 


= h.( 

V 7T \ 


of which h v is defined by 



\ * V* ) 


6. Plot curves like those of Figs. G, 7, and 8 to represent the distribution of data 
given in Table I. What is your conclusion regarding the sensitivity of the various 
methods of plotting in showing variations of distribution curves from normal? 

6. The mean annual temperatures of Pittsburgh reported by the U. S. Weather 
Bureau for the 71 years, 1872-1942, are 


Ranges of Mean Annual Temperature 

in °F 

48.8- 49.2 

49.3- 49.7 

49.8- 50.2 

50.3- 50.7 

50.8- 51.2 

51.3- 51.7 

51.8- 52.2 

52.3- 52.7 

52.8- 53.2 

53.3- 53.7 

53.8- 54.2 

54.3- 54.7 

54.8- 55.2 

55.3- 55.7 


Number of Years of Occurrence of 
Means Within the Specified Ranges 

1 

2 

1 

3 

6 

8 

8 

9 

10 

10 

7 

5 

0 

1 


Make graphs of the data similar to those of Figs. 6 and 7. Determine values for the 
mean annual temperature and for />, a, and \/h. Judged from the distribution given, 
what is the probability that the mean temperature of Pittsburgh for the coming year 
will fall between 49.5° F and 50.5° F? What are the limits of the smallest range of 
temperature within which that temperature has a 50% chance of occurring? 

7. Using Fig. 10 and Birge’s data as recorded in Table II, determine the values of 
a and P x 2 which apply. Choose the limits for the various frequency ranges such 
that at least 10 residuals will be included within each range. 



CHAPTER VIII 


MEANS AND PRECISION INDEXES OF UNEQUALLY 

WEIGHTED MEASUREMENTS 

1. Introduction. In the preceding chapter, we derived expressions 
for the precision indexes, (l//i) x , <r x , a x , and p x , of a single X-reading 
chosen at random from a series of equally precise readings assumed to 
obey the normal distribution law. We found, among other things, that 
these indexes tell us the likelihood that a single reading will deviate 
from the mean of the series by a certain amount. Granted this, it now 
becomes desirable to know the precision indexes of the mean itself, i.e., 
the likelihood that the mean will deviate by a certain amount from the 
so-called grand mean, the mean of a series of similarly determined means. 
To know that an individual reading of a specified length has a probable 
error of 0.05 mm is worth while; to know that the mean of a series of 
length readings has a probable error of 0.002 mm is generally more 
important. 

Some readings of a series may, because of conditions, be more reliable 
than others. It is then customaiy to assign weights to the individual 
readings. Usually such assigned weights are arbitrary, though not 
without reason. Often the assignments are in accord with some plan. 
If one reading is considered, roughly speaking, twice as reliable as a 
second, respective weights having the ratio 2 : 1 may be assigned; 
e.g., weights of 4 and 2, or of 1 and Yi, etc. For a group of such read¬ 
ings, as for one of equally reliable readings, it is desirable to obtain the 
most probable mean and its precision indexes. 

In this chapter we first derive an expression for the mean of a series 
of weighted measurements. The precision indexes of the individual 
weighted readings are then obtained, and their relationship to the arbi¬ 
trary weights is pointed out. We next consider the mean, whether 
obtained from equally or unequally weighted readings, as a particular 
kind of weighted reading, and derive its precision indexes. A short 
method for computing means and precision indexes from unequally 
weighted readings is then presented. Finally, we consider the problem 
of combining several mean values of a quantity into a grand mean and 
its precision indexes, first for the case where the intermediate means 
are consistent, and then for the case where they are inconsistent. 

189 
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2. The Mean of Weighted Single Observations of a Quantity. In 

what follows, we assume that a reading X\ having a weight W\ is equiva¬ 
lent to Wi readings of unit weight whose mean is X\. This does not 
exclude fractional weights, since weights are only relative; the question 
of what might be meant by 0.1 reading of unit weight is irrelevant. 
As will be shown, it is important to recognize that these W\ readings are 
not individually assumed equal to X\ and that only their average pos¬ 
sesses that value. 

Let Xi, X 2r * m X„ be a series of measurements having weights w lf 
w 2 j’ * •«>„, respectively. By our assumption, this series is equivalent to 
a particular series having (w x -f w 2 H— • w n ) readings of equal precision. 
Ihe mean of this new series, and hence also of the unequally weighted 
series is evidently 

_ w iXj -j- w 2 X 2 + • • • w n X n _ 'ZwX 
W\ -f- w 2 -f- • • • w n 


3. Precision Indexes of Weighted Single Observations. Let X u 

X 2f • •-AT n be a series of observations having known weights, w\ t iv 2 , 
• • • w nt but unknown moduli of precision, h u h 2 , • • -h n . We again obtain 
an expression for the mean of this series, but this time by the method 
discussed on page 161, making use of the variable pseudo-mean, X". 
As in Chapter VI, we seek the X" possessing a maximum probability 
of occurrence for the observed data. Assuming a normal distribution 
wherein xi, x 2) • • • x n are the deviations from X" of X it X 2i • • • X„ , meas¬ 
urements having least counts of A.r, we have 


(A n P), i2l 3= A P Xx X A P X2 X • • • A P x 


n 



Xli 2 X - ■ h n )e~ (Ax) n [2] 


= a maximum 


or in logarithmic form 


In (A n /' > )i f 2 , 3 , ■ ■ • n — —n hi (\/7r) + 2 In h — (h 1 2 .ri“ -f- • • • h n 2 x n 2 ) 


+ n In (Ax) [3] 


= a maximum 


Differentiating with respect to X", we write 



[In (A"P)] 
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Since 


dx i 

dX" 


dx 2 

dX" 




we have as the condition for the maximum 1 probability of occurrence 
of the observations 


h x 2 xi + h 2 2 x 2 -\ - h n 2 x n = 0 



Representing the value of X ", computed in accord with Eq. 6, by X, 
we write 

2 h 2 x = 2 h 2 (X - X) = 2 h 2 X - XXh 2 = 0 [7] 

or 



Comparing Eqs. 1 and 8, remembering that the values of h are inde¬ 
pendent of each other, we find h 2 proportional to w, or 





The relative precision indexes for the unequally weighted readings are 
therefore given by 

J_ _ 

-^ = — = — = — = \/— [10] 

1 p 2 a 2 cr 2 y Wi 

h 2 

The precision indexes of weighted single observations of a quantity vary 
inversely as the square roots of their weights. Letting /?, a, and p, in 
the further discussion, represent the moduli of precision for an observa¬ 
tion arbitrarily assumed to have unit weight, we obtain from Eq. 9 


1 


1 h 

hi v wi 

[11] 

Vm 

[12] 

V 

Pl V w 1 

[13] 


1 That Eq. 6 represents a maximum rather than a minimum is shown by the 
standard procedure of differentiating Eq. 4 to obtain <P/{dX") 2 , a quantity which is 
found to be essentially negative. 
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We may now assign absolute values to the precision indexes of the 
unequally weighted observations X u X 2 , - X n . We merely replace 
the various K s of Eq. 3 by their equals as given by Eq. 11. There 
follow 


In (A"P)i i2i ...„ = \ In W ' W2 ' Wn + n In h - h 2 Zwx 2 + n In (Ax) [14] 

7r 


= a maximum 


d 

dh 


[In (A"P) ll2 ....„] = ~ - 2hXwx 2 = 0 




Hence, for the observation having unit weight, 


and 





2?wx 2 


n 






= 0.67(7 = 0.67 




'Zwx 2 


n 



[17] 1 

[18] 1 

[19] 1 


By substitution in Eqs. 11 to 13, similar expressions follow for the pre¬ 
cision indexes of other observations of different weight. Eqs. 17 to 19 
differ significantly from the corresponding expressions derived in Chapter 
VII for observations all of which arc of equal weight. In place of the 
2ic that one might offhand expect in the denominators of these equa¬ 
tions, theory shows the presence of n. This is the evidence for the 
caution given above when stating that a reading X\ with weight W\ is 
not equivalent to w x identical readings X\ all of unit weight. We may 
now illustrate the statement that reading X! with weight W\ cannot be 
so considered. In Table I are presented three groups of readings. The 
first reading, 43, of group 1, with a weight of 5 is replaced in group 2, 
in accord with the faulty assumption, by five readings of 43, each with 
unit weight, and in group 3, in accord with the probable correct assump¬ 
tion, by five readings, each of unit weight, whose mean is 43. It is to 
be noted that these five vary among themselves to about the same ex¬ 
tent as the remaining five which are assumed throughout to have unit 
weight. It is seen that the computed values for a for groups 1 and 2 

1 See footnote on page 167. 
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are necessarily different, whereas those for groups 1 and 3 are essentially 
alike, in conformity with what theory suggests. 

4. Precision Indexes of Means. If the reading Xi with weight w\ is 
equivalent to W\ readings whose mean is X\> then the inverse is also 
true: n readings of unit weight whose mean is X are equivalent to a 

TABLE I 


Showing That a Reading Xi with Weight wi Is Not Equivalent to w\ Read¬ 
ings Each Having the Value Xi 


Group 1 

Group 2 

Group 3 

X 

w 

X 

wx 2 

X 

w 

X 

wjt 

X 

w 

X 

wx 2 






43 

1 

0.5 

0.25 


1 

2.5 

6.25 






43 

1 

0.5 

0.25 

H 

1 

0.5 

0.25 

43 

5 

0.5 

1.25 


43 

1 

0.5 

0.25 


1 

2.5 

6.25 






43 

1 

0.5 

0.25 

44 

1 

1.5 

2.25 






43 

1 

0.5 

0.25 

43 

1 

0.5 

0.25 

39 

1 

3.5 

12.25 

39 

1 

3.5 

12.25 

39 

1 

3.5 

12.25 

44 

1 

1.5 

2.25 

44 

1 

1.5 

2.25 

44 

1 

1.5 

2.25 

42 

1 

0.5 

0.25 

42 

1 

0.5 

0.25 

42 

1 

0.5 

0.25 

45 

1 

2.5 

6.25 

45 

1 

2.5 

6.25 

45 

1 

2.5 

6.25 

40 

I 

2.5 

6.25 

40 

1 

2.5 

6.25 

40 

1 

2.5 

6.25 


Xwjr = 

= 28.50 




28.50 




42.50 



X = 

= 42.5 




42.5 




42.5 

\ 

Izwx 2 

J n 

= <T = 

= 2.2 




1.7 




2.1 

y 













single reading X whose weight is n. Hence, in view of Eqs. 18 and 19, 
the precision indexes of a mean obtained from n equally weighted 
readings are given by 

(a - (0 - 


ax = 


yfn 

°x 
y/ n 


VZx 


n 


Vx V 2x 2 

Px — ~ 7 = = 0.67ff^ = 0.67-, etc. 

V n n 


1 See footnote on page 167. 


[ 20 ] 


[ 21 ] 


[ 22 ] 
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where (l/h) x , *x, etc., represent the precision indexes of an individual 
reading of unit weight. 

For a mean, X, obtained from unequally weighted readings, similar 
reasoning allows us to consider X as a single reading with the weight 
2ic. Hence for this case, 


ax = 


v.x 


V2 


w 


_ jZwx 2 
' riZw 


[23] 


P-v 

Px = = 0.0/cry 

\/Zw 


= 0.67 yj 


Zwx 2 

nZw 


, etc. 


[24] 


T he probable error of the mean, py, is the quantity which physicists 
generally accept as a measure of the accuracy of a reported result. It 
predicts that of a great number of similarly determined means, just 

one-half should normally deviate from the grand mean by an amount 
greater than py. 

AYith weights assigned according to Eq. 10, it usually happens that 
the numbers taken proportional to (1/p) 2 turn out to be awkward. In 
such cases, one uses rounded values for the w’s with seldom more than 
two significant digits. For example, with pi : p 2 : p 3 :• • • varying as 
3 : 40 : 8 :• • •, we might well use w x : m> 2 • Wa :• • • varying as 1100 : 6 : 
1 (50 : * • * rather than 1111.11 : 6.25 : 156.25. The departures from 
theory introduced thereby are not only very small but are quite justi¬ 
fiable in view of the general theory itself. 

5. A Short Method for Computing Means and Precision Indexes 
from Weighted Observations. Just as in equally precise measurements, 
much time and labor may be saved by using a short method for com¬ 
puting X, <ry etc., for weighted measurements. Proceeding as on page 
108, selecting X' as a convenient approximate mean, and representing 
X — X f by A, we obtain 





+ A = X' + 






nZw 


Zw(X - X') 2 - A 2 Zw 

nZw 



The computations are conveniently carried through in tabular form 
as in Table II. As a check, the calculation of X and ax may be repeated, 
using a different value of X'. 


1 See footnote on page 107. 
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TABLE II 

Illustrating a Short Method for Computing X and ax from Weighted Data ; 

Together with a Convenient Check 





X' = 128 

X' = 129 

X 

/ 

2 w x 

X—X' 

ZivAX-X') 

2 w z (X-X')* 

X-X* 

2u> I (X-X') 

2 wAX-X')* 

125 

2 

2 

-3 

- 6 

18 

-4 

- 8 

32 

126 

3 

5 

-2 

-10 

20 

-3 

-15 

45 

127 

9 

18 

-1 

-18 

18 

-2 

-36 

72 

128 

15 

45 

0 

0 

0 

-1 

-45 

45 

129 

11 

35 

1 

35 

35 

0 

0 

0 

130 


12 

2 

24 

48 

1 

12 

12 

131 


2 

3 

6 

18 

2 

4 

8 

132 

1 

1 

4 

4 

16 

3 

3 

9 


50 

120 


35 

173 


-85 

223 


A = 

X = 

= 


vx = 


Mu = 0-29 

128 + 0.29 = 128.29 

173 - 120(0.29) 2 
50 X 120 

0.16 

0.67 X 0.16 =0.11 



A 

X 

*X 


-Mo = -0.71 
129 - 0.71 = 128.29 


■V 


223 - 120( —0.71 ) 2 


50 X 120 


VX = 


0.16 

0.11 


The data of Table II are those of Table I, page 170, with arbitrarily 
assigned weights. For the equally weighted data, X and ax are found 
to be 128.3 and 0.21. Comparing these with the values from Table II, 
we note that the means are nearly identical but that the ax i»s appre¬ 
ciably smaller for the weighted data. This is a consequence of the 
arbitrarily greater weightings of measurements near the mean. 

6. The Grand Mean and Its Precision Indexes. The concept of a 
grand mean arises when one wishes to combine, for instance, various 
determinations of the velocity of light, c, such as Michelson made with 


8-sided, 12-sidcd, and 10-sided rotating mirrors of glass and of steel, in 
an attempt to determine the best value for c, and the probable error, p c . 

Let X lf X 2 , • bea set of intermediate means, corresponding in 
the above example to determinations of c made with (1) an 8-sided 
glass mirror, (2) a 12-sided steel mirror, etc. Let px 2 , • • -px n be their 
probable errors. It is assumed that these intermediate means differ 
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because of accidental errors only. As has been shown, the weights of 
these means vary inversely as the squares of their probable errors, and 
we may assign to them the arbitrary weights k 2 /px 2 , k 2 /px 2 , • * • 
k 2 /px 2 , where k is a constant and may be interpreted as the probable 
error of a mean of unit weight. Further, as also shown above, X\, 
^ 2 ,’ • 'X n may be viewed as the means of k 2 /px 2 t k 2 /px 2 ,’ • • k 2 /px 2 
individual measurements, all of the same precision. With this under¬ 
standing, Eqs. 1 and 24 may be used to obtain the desired mean and 
its probable error. They yield 




It is seen that px is smaller than the probable error of any of the inter¬ 
mediate means. 

In illustration, where (10.0 =fc 0.2) gm, (10.2 ± 0.5) gm, and (9.9 ± 
0.4) gm are the intermediate means, we have, corresponding to an 
arbitrary selection of 4 gm 2 for k 2 , the following results: 


Y 

PX 

k 2 

PX 2 

px 

10.0 gm 

0.2 gm 

100 

1000.0 gm 

10.2 

0.5 

16 

163.2 

9.9 

0.4 

25 

247.5 



141 

1410.7 gm 


~ _ 1410.7 

gm 

— = 10.00 

gm 


141 


2 gm 

VX VI41 

= 0.17 gm 



7. The Precision Index of a Precision Index. In reporting a precision 
index, a question of concern is that of the extent to which it should be 
expressed. Should the number of significant digits be one, two, three, 
or more, or should it vary with the case at hand? A common-sense 
answer will usually suffice, and without doubt the number of digits de- 
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pends on the case at hand. Obviously when n is large, more confidence 
may be given to derived values for p and a than when n is small, but 
this rule is only roughly comparative. It would be highly gratifying, 
however, to have a rule based on theoretical considerations if possible 
which is universally applicable. 

One rule 1 states that the standard deviation of a itself is given ap¬ 
proximately by 


(T 

v<j = 7 — 

V2 (n - 1) 



For example, if n — 9, l/y/2(n — 1) = Y± and therefore one need re¬ 
cord not more than two figures in a and, at that, the second figure is 
barely significant. With n = 9 and the first digit 8 or 9, not more than 
one digit is needed. Similarly for probable errors, the rule states that 
the probable error of p is approximately given by 

_ 2 P 
P ” W2{n - 1 ) 



More than two significant digits are rarely neede d for the proper expres¬ 
sion of a probable error. Where n = 100, 2 3\/ 2{n — 1) approximates 
1/14. Depending, in this instance, on whether the first digit of p is 
greater than or less than 2, we may well limit the expression of p to 
only two or to only three digits with the last rounded to 0 or to 5; e.g., 
p = 0.42 or p — 0.115. 

8. Internal versus External Consistency. It has been mentioned, but 
should be emphasized here, that when we consider the mean to be the 
most probable value obtainable from a set of measurements, we make 
the principal assumptions (1) that the measurements are normally dis¬ 
tributed, and (2) that they deviate from the true value because of acci¬ 
dental errors only. The first assumption is generally fulfilled to a mod¬ 
erate degree and in any case can be tested. The second, however, is 
often invalid; a constant error in theory, apparatus, procedure, etc., 
may cause the mean to deviate from the true value by many times its 
probable error. It is impossible to detect such a constant error from 
the frequency distribution of a single set of measurements, or of a set 
of means of measurements taken under essentially identical conditions. 

For the cases thus far discussed, we can proceed only as we have and 
consider all errors accidental. When, however, we wish to combine or 
compare the results of several workers, using different methods, appa¬ 
ratus, etc., we frequently find evidence for the occurrence of constant 

1 Rossini and Deming, J. Wash. Aca:!. Sri., 29, 416 (1939). 
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errors. Such discrepancies, for example, are shown in Bleakney’s 1 
tabulation, presented in part in Table III, of the ionization potentials 
of molecular hydrogen as determined by various observers. 

Table III 

A Set of Inconsistent Mean Values for the H2 Ionization Potential 

as Measured by Various Observers 

(16.5 ± 0.5) volts (15.4 ± 0.1) volts 

(17.1 db 0.2) (15.6 dfc 0.1) 

(15.6 ± 0.1) (15.37 ± 0.03) 


1 hose values differ from each other much more than their probable 
errors indicate that they should. Constant errors must have entered 
into some or possibly all of the determinations. It would be incorrect 
to combine these means into a grand mean and compute its probable 
error by Eqs. 27 and 28. We are thus faced with two problems: (1) 
How may inconsistent means be combined best into a grand mean and 
its probable error determined? (2) When is a set of means to be con¬ 
sidered inconsistent rather than consistent? 

9. Testing Intermediate Means for Consistency. Several tests for 
consistency of means have been proposed, some more arbitrary than 
others. Thus, for thermochemical measurements, Rossini and Deming 2 
propose that two means be considered inconsistent when they differ by 
more than twice the sum of their standard deviations. A second test 
for inconsistency compares the difference between two means, X 2 — 
with the standard deviation, a, of that difference; and if the probability 
of occurrence of a difference as great as X 2 — X\ on the basis of the 
computed a is found to be less than 0.01, the means are declared incon¬ 
sistent. The procedure follows. It can be shown (Chap. IX) that the 
standard deviation of the difference of two means of normally distributed 
sets of measurements is related to the standard deviations of the means 
by the equation 

<qv 2 -y,) = Vav, 2 - 1 - ax* [31] 


With the a- ( y 2 _,Yj) determined, the corresponding hx is then obtained 
using the relation 



Next in Table II, Appendix 2, one seeks the probability of occurrence 
of an hx as great as that just computed or greater. The decision follows. 

1 Bleakney, W., Phys. Rev., 40, 497 (1932). 

- Rossini and Deming, op. cit., p. 416. 
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If the computed hx turns out to be greater than 1.83, the means are 
to be declared inconsistent on this basis. 

A third criterion of inconsistency, proposed by Birge, 1 consists in 
assigning the arbitrary weights k 2 /px x 2 , k 2 /px 2 } etc., to the set of n 
means and calculating the grand mean by Eq. 27. Then, on the basis 
of internal consistency, the probable error of a mean of unit weight is 


^internal ^ 


[33] 


and on the basis of external consistency, applying Eq. 19, it is 


Pexternal 


= 0.67 Y 


2w(X - X) 


n 


[34] 


Hence, if the set of means is consistent, the ratio 


, 0 . 67 A - *> 


^internal 


nk 


[35] 


should equal unity except for statistical fluctuations. Birge assumes 
that the ratio Pextemai/Pintemai is normally distributed about the mean 
value, 1, with the modulus of precision \/~n. The probability of occur¬ 
rence of an observed deviation from unity may then be found by calcu¬ 
lating the corresponding value of hx 




^external 

Pinternal 




and using Table II, Appendix 2. If this probability is less than 0.01, 
i.e., hx > 1.83, the means are considered inconsistent. 

Because of the assumptions made in deriving Eqs. 32 and 36, the 
probability values obtained do not have the exact significance that has 
been given them. Nevertheless the tests are useful for detecting in¬ 
consistencies in values obtained by different observers. 

10. Combining Inconsistent Means. When a set of means is not con¬ 
sistent, we may assume, for lack of anything better, that the constant 
errors which enter to cause the means to deviate from the true value 
are distributed normally. We then have as alternate methods for find¬ 
ing S’: (1) averaging the intermediate means without regard to weights 
or probable errors; (2) assigning arbitrary weights to the intermediate 
means, perhaps on the basis of experience with the customary accuracy 
of the observers involved, and finding X by applying Eq. 1; or (3) 

1 Birge, R. T., Phys. Rev., 40, 213-224 (1932). 

2 See footnote on page 167. 
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assigning weights proportional to_the inverse squares of the reported 
probable errors and calculating X by Eq. 27. This is equivalent to 
assuming that a worker who obtains a great number of values, or very 
consistent ones, is more likely to eliminate constant errors than a worker 
whose values are fewer or less consistent. Generally method (2) or (3) 
is preferable to (1). 

_ Regardless of which of the three methods above is used for calculating 
X, Eq. 28 should not be used for finding px, since, because of constant 
errors, X is not as accurate as this result would indicate. Instead, we 
should consider the intermediate means to be elementary observations, 
weighted in accord with the method used in obtaining X, and calculate 
Px by applying Eq. 24. Calculating the grand mean and probable 
error for the values of Table III by Eqs. 27 and 24 yields (15.44 db 0.07) 
volts. This indicates the accuracy with which we know the H 2 ioniza¬ 
tion potential better than the value obtained by using Eqs. 27 and 28, 
namely (15.437 ± 0.027) volts. 

11. Why Inconsistent Means? Several reasons for inconsistent means 
may be mentioned. In what follows we shall ignore errors that are 
purely computational. 

(a) Errors of Construction of Instruments. These errors are numerous. 
Consider the spectrometer. The angle scale may be irregular, it may he 
mounted eccentrically with respect to the main vertical axis, it may he 
mounted with its normal at an angle with the main vertical axis. The 
collimator and the telescope may not point perpendicular to or toward 
the main axis. Other constructional faults are more or less obvious. 

(b) Errors of Experimental Procedure. Readings may not be taken in 
a truly chance order. Particularly, if y-values are determined for a 
sequence of a:-values increasing or decreasing consistently in magnitude, 
possibilities for a gradual instrumental or other drift may not be ob¬ 
served though observable. A one-sided scale illumination may be used. 
Where cross-hair settings are made, this may be a source of considerable 
error. Readings may be taken under conditions where an observer 
making settings is cognizant of the general trend of the readings taken. 
Under such conditions succeeding settings will not be independent. It 
is rather difficult for one making settings to follow a setting that he 
believes low, for instance, in consequence of readings reported, with a 
setting that is not biased in the opposite direction. A maker’s scale 
may be assumed correct. Temperature variations may be ignored. 
Faulty instrumental construction may be ignored. Where small elec¬ 
trical emf’s and small variations are important, constructional materials 
and designs become vital. Other procedure errors are more or less 
obvious. 
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(c) Errors of Statistical Treatment. One may attempt to determine a 
precision index for a case where the least count is of the same order of 
magnitude as the precision index to be determined. One may easily 
obtain an exalted view of one’s own precision under these circumstances. 
One may assume an erroneous distribution of variations of observed 
values from the mean. Generally the apparent inconsistencies between 
means will be lessened rather than increased on this score. One may fail 
to assign weights properly to the various readings forming a group. 
A single reading whose weight is given as zero by the application of 
Chauvenet’s criterion may, if included, yield a mean to which but 
little weight may be given. One may ignore or treat incorrectly the 
contributions of certain factors in determining a precision index for 
a mean. See Chapter IX, which concerns the propagation of precision 
indexes. 

( d ) Errors of Theory. Difficulties arise here particularly when some 
one or more constants enter in the production of widely differing phe¬ 
nomena. The case is well illustrated in Chapter X in the discussion of 
the present dilemma with regard to the constants of atomic physics. 
Errors of theory are not always easy to correct. 

(e) Errors of Unsuspected, Sources. These are the errors that remain 
after all other imagined probable sources of error are given considera¬ 
tion. With discovery, an error belonging to this group is transferred 
at once to one of the above groups. 

12. Summary. When combining readings certain of which are be¬ 
lieved more reliable than others, the resultant mean is believed improved 
if relative weights arc assigned to the individual readings. Specifically, 
if pi and p 2 are the probable errors of two observations, X r and X 2} 
the relative weights are given by 


w 2 




and the mean of the series of observations is found to be 



The probable error of the mean of n observations is given by 


Vx 

PX = -y 

V'< 


[22] 
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PROBLEMS 

1. Given the intermediate means: 

10.01 ± 0.25 gm 9.98 db 0.04 gm 

10.00 ±0.12 9.97 ±0.06 

• 9.99 ±0.05 9.96 ±0.15 

Find the best grand mean and its probable error. 

2. Show that if 400 measurements of equal precision are divided into five groups, 
of say 40, 60, 80, 100, and 120 readings, selected at random, to yield intermediate 
means with varying probable errors, and these are then combined to yield a grand 
mean for the whole group with a probable error determined by the method outlined, 
the results will be the same as those obtained by treating the 400 measurements as a 
single group. 

3. Beattie, 1 summarizing the values obtained lor the ice point on the Kelvin 
scale, gives the following for the measurements reported in 1937 and before. On 
the basis of these data, what is the expected value of the ice point? First treat all 
as belonging to a single group and then second as belonging to two separate groups. 


Gas Used 

Method 

No. of Points 

T 

He 

a v 

21 

273.176° K 

He 

CCp 

10 

.157 

h 2 


19 

.139 

h 2 

oc p 

8 

.131 

n 2 

OCv 

27 

.138 

n 2 

CCp 

15 

.143 

Ne 

Ctv 

4 

.212 

Ne 

Ctp 

4 

.129 


Are the means for the two groups consistent? Why does not the grand mean for 
the two groups check with the group mean? 

4. In Bearden’s paper “A Determination of c/m from the Refraction of X-Rays 
in a Diamond Prism” ( Phyx. Rev., 64, 698 (1938)), there is given, in Table I, a set of 
experimental values for 5, i.e., 1 — m, where p is the index of refraction. In Fig. 4 of 
that paper there are given the weighted mean values of c/m as obtained by various 
workers, together with their probable errors. Find (1) the mean of the 5’s given in 
Table I, together with its precision indexes, and (2) the weighted mean value of e/m, 
taking into account all values plotted in Fig. 4 of the paper, together with its prob¬ 
able error. 

1 Beattie, James A., in Temperature — Jin Measurement and Control in Science and Industry, p. 83, 
New York, Ileinhold Publishing Corporation, 1941. 


/ 
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5. Dunnington 1 has given the following summary of e/m o measurements for the 
electron. Compute the weighted mean and its probable error. 


Experimenter 

Date 

Method 

10 7 c/mo 

10 -3 p 




emu 

0 

emu 


Bound Electron or Spectroscopic Group 


Houston 

1927 

Fine structure H 1 —He 4 

1.7607 

10 

Kinsler and Houston 

1934 

Zeeman effect 

1.7571 

7 

Shane and Spedding 

1935 

Fine structure H 1 —H 2 

1.7582 

4 

Williams 

1938 

»t 

1.7580 

4 

Houston 

1938 

a 

1.7593 

5 


Free Electron Group 


Perry and Chaffee 

1930 

Linear acceleration 

1.7610 

10 

Kirchner 

1932 

i i 


9 

Dunnington 

1937 

Magnetic deflection 

1.7597 

4 

Shaw 

1938 

Crossed fields 

1.7581 

13 

Bearden 

1938 

X-ray refraction 

1.7600 

3 


1 Dunnington, F. G., Rev. Modern Phya., 11, 65 (1939). 
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1. Introduction. In Chapter VI it was shown that the arithmetic 
mean of a series of measurements is the “best” value of the quantity 
measured, and in Chapters VII and VIII methods of obtaining the 
precision indexes of such measurements and means were described. In 
a great number of cases, however, the quantity sought cannot be meas¬ 
ured directly but must be calculated from the means of two or more 
other directly measured quantities. Thus, we have 

(a) a length which is obtained by subtracting one position reading 
from another; 

(b) the specific heat, r, of the material of a body which cools by radi¬ 
ation only, in vacuo, in accord with the equation 

c = M*. tl] 

mdT/dt 1 J 


where m, dQ/dt, and dT/dt are, in order, the mass of the body, its rate 
of loss of energy by radiation, and its rate of cooling; 

(c) the computed first radiation constant, a (often called the Stefan- 
Boltzmann constant), as obtained from the equation 


2 t r 5 k 4 

* ~ 15/rV 



where k, h, and c are, in order, the Boltzmann atomic constant, the 
Planck constant, and the velocity of light in free space; and 

(d) the index of refraction, n, of the glass of a prism for a particular 
wavelength of light, obtained with the aid of a spectrometer, using the 
equation 

. A+D 

sm-— 

n - -— [3] 

sin — 

2 


where A and D are the angle of the prism and the minimum deviation 
produced by the prism for the particular wavelength of light used. 
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It is, of course, just as desirable to know the reliability of such in¬ 
directly measured quantities as of the directly measured ones previously 
discussed. 

Evidently the precision indexes of a calculated quantity depend on 
the indexes of the measured quantities of which it is a function. Their 
calculation, given the means and the precision indexes of the measured 
quantities, is based on the following theory of the propagation of pre¬ 
cision indexes. 

In this chapter we shall consider how to determine the precision 
indexes of an indirectly measured quantity, V , in terms of the directly 
measured quantities X and Y and their indexes, first for special cases 
such as those involving sums, products, etc., and finally for the general 
case where U is any function of X and F. The application of the 
principle of the propagation of precision indexes to the problem of de¬ 
signing experiments is also discussed. 

2. Cases Involving a Sum or Difference. Let 

r = X + F [4] 

where X and Y are the means of two separate sets of readings, with 
probable errors py and py. We assume that each of the two sets in¬ 
volved the same number of readings, say 20 or 50, with precisions such 
as to give the resultant values of py and py. Whether or not the actual 
sets of observations involved equal numbers of readings is immaterial. 
All that is necessary is to be assured that the assumed sets are equiva¬ 
lent to the actual sets. 

With the pairing done at random, let the assumed individual X and Y 
readings be paired off to give (Xi, Y\), (X 2f F 2 ), etc. We may then write, 
where u\, X\ } y\, etc., are deviations from the means U f X , and Y 

l i = F 4- wi = X\ -T Y\ = X + x\ 4- Y 4- y\ ^ 

l 2 = l H- w 2 = A 2 + I 2 = X + *2 + I 4" 2/2) etc* 


In view of Eq. 4, these may be rewritten as 

mi = 4- y i 


By definition 


However, 


M 2 = *2 4- 2 / 2 , etc. 



hr = hr 2 4- 2 hnj 4- V 




i 



1 See footnote on page 167. 
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of which for the normal case we set 

22*2/ = 0 [9] 

because any particular product xy is as likely to be positive as negative 
and the summation on that account will tend toward zero. It follows 

that _ 

<tu = y/ &x 2 + <?y 2 

PV = V py 2 + Pv 2 [11] 

i 

and similarly for the other precision indexes. 

The probable error of a sum is less than the sum of the probable 
errors of the components. Rather, it is the square root of the sum of 

the squared probable errors of the components. 

It is evident that where U = X - F, the equation corresponding to 

Eq. 8 will be 

2u 2 = 2x 2 - 2 Zxy + V [8a] 

and that the final expressions for <jji and pu will be identical with Eqs. 
10 and 11. 

3. Cases Involving a Product or a Quotient. Let 

U = XY [12] 


Then, with the same assumptions as were made in the preceding sec¬ 
tion, we obtain 

17, = XyYt, etc. [!3] 

U + w, = (X + x,)(F + l /,) = XY + x,F + Vl X + xiyi, etc. [14] 


and, since the product x,t/, is of the second order in comparison with 
the other terms 


and 


As before, 


so that 


u, = x,F + y\X, etc. 

[15] 

2u 2 = F 2 2x 2 + IXY-Lxy + X 2 Zy 2 

[IB] 

2xi/ = 0 

[17] 

. 2u 2 F 2 2x 2 , X 2 2 y 2 

- n 2 n 2 + « 2 

[18] 

= FW + X 2 ay 2 


,V 2 *X 2 , ^ 

U 2 X 2 F 2 

[19] 


and finally 
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Following a procedure very similar to the above, it is not difficult to 
show that for the case of a quotient, where 

U=y [12a] 

the expressions obtained for <jjj and pjj are exactly those of Eqs. 19 and 
20. The proof of this fact is the subject of one of the problems at the 
end of the chapter. 

4. Cases Involving Multiplying Constants and Constant Powers. 
Let 

U = AX a [21] 

On the basis of the assumptions made in the previous two sections, we 
obtain in order 

Ui = AX x a , etc. [22] 

U + u { = A(X + *,)«, etc. [23] 



U\ = A ax i X a 1 

, etc. 

[24] 

and 

2a 2 = A VX 2 “- 2 2x 2 = 

X 2 

[25] 

whence 

II 

[26] 


and 

PU p.v 

u ~ a x 

• 

[27] 


Note that the a in Eqs. 20 and 27 is the square root of a 2 , and hence 
may always be taken as positive, regardless of the sign of a in Eq. 21. 

5. The General Case. Let 

U = f(X t F) [28] 


Applying Taylor’s expansion and making the assumptions of the pre¬ 
vious sections, we obtain, evaluating the partial derivatives at L = C 



SOLUTIONS OF ILLUSTRATIVE PROBLEMS 209 


V + u 1 = f(X + x u 7 + yi) 


[29] 


[30] 


[31] 

'Lxy = 0 

[17] 

so that 

2 ( dU Y 2 , ( dU Y -2 

an ~ \ex) ax + Var/ ^ 

[32] 

and 

2 (*V\ 2 2^( dU \ 2 

vv = \m) px + W pr 

[33] 


Obviously, Eqs. 32 and 33 apply to the special cases discussed above. 

6. Solutions of Illustrative Problems, (a) With what precision may 
the sine of an angle in the neighborhood of 75° be determined when the 
probable error of the angle measurement is 0.02°? 

Solution: 

U = sin X P 4 ] 



1 radian 0.02 

PU = (cos 75°) X 0.02° X 5?3 -— = 0.2G — 

( b) What is the computed first radiation constant 
error, using the relation 

2t r 5 k* 



15/tV 


[35] 

= 0.00009 [36] 1 

and its probable 



and the following values for k, h, and c? 

k = 1.3803 X 10 —16 (I dt 0.00023) erg/(molecule K° ) 

h = 6.6283 X 10 -27 (1 ± 0.000J 3) erg sec 
c = 2.99776 X 10 10 (1 ± 0.000013) em/sec 

1 That the radian is a natural unit for the sine of an angle and for its probable 
error as well as for the angle itself is generally ignored. That it may he so considered 
seems supported by the well-known expansion 

sin 0 = 0 - 073! + 075!- 
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Solution: 

Applying Eq. 33, one obtains 





16 ^+ 9 ^+ 4 ^ 

fr cr 

1G(0.00023) 2 + 9(0.00013) 2 + 4(0.000013) 

0.0010a 



[38] 

[39] 


and the constant, after its value has been separately determined, may 
be reported as 

a = 5.600 X 10" 5 (1 ± 0.0010) erg/(cm 2 sec K oA ) [40] 


7. Cases Where the Precision Indexes of the Component Quantities 
Are Not Independent. Any propagation equation will yield incorrect 
results unless the directly observed precision indexes are truly inde¬ 
pendent. Special care should be taken when using one of the special- 
case equations. Thus, if 

U = 2X [41] 

we may find pu correctly by Eq. 27 on the basis that U = .4 X a with 
A = 2 and a = 1. Then 

vu = y Px = 2 P X t 42 ] 

If, however, we use Eq. 11 assuming V = X -f F and that X\ = Yu 
X 2 = T l >, etc., we obtain 

pu = V ps 2 -f px 2 = \/2px [ 43 J 

which is too small by the factor y/2. This error arises in accepting 
the assumption, made during the derivation of Eq. 11, that the pre¬ 
cision indexes of X and Y arc independent and that therefore 'Zxy is 
negligibly small or zero. However, the assumption of independency is 
not justified here and 2 xy cannot be set equal to zero. 

Similarly, to find pp when V = A" 2 , we use Eq. 27 on the basis 
U = AX a with A = 1 and a = 2, and not Eq. 20 on the assumption 
that V = XY where X = F. Simple cases such as these can usually 
be handled without difficulty if the general propagation law, Eq. 32 or 
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Eq. 33, is applied, but they do indicate how difficulties arise when the 
component precision indexes for X , F, etc., are not independent. 

A somewhat more complex case is illustrated in Eq. 3. If one views 
the quantity n as the simple ratio of two measured quantities and at¬ 
tempts to apply Eq. 20, he will neglect the fact that the numerator and 
denominator are not independent. The correct procedure for this 
case is the subject of one of the problems at the end of the chapter. 

A still more complex case cited by Birge 1 is that of finding the pre¬ 
cision index of the Sackur-Tetrode constant, So, as defined by 


(2x*)’ s e 0 

s ° = R ° ]n -mr- 



of which R 0 , k , e 0} h } and N 0 represent, in order, the ideal gas constant, 
the Boltzmann atomic constant, the base of natural logarithms, the 
Planck constant, and the Avogadro number. Actually, not one of the 
variables on the right-hand side of the equation is independent of the 
others. Thus, 

(1) ^ [45] 

where v n , A n , T 0 , and J l5 , representing respectively the molal volume 
of an ideal gas under standard conditions, the standard atmosphere, 
the ice-point, and the mechanical equivalent of heat, are independently 
measured, 

(2) N 0 = — [-*6] 


where F , c, and e, representing, in order, the faraday, the ratio of the 
escoulomb to the abcoulomb, and the electronic charge, are independ¬ 
ently measured, 


(3) 

and 

(4) 


k = 


Ro 

v„A „e 

[47] 

No 

ToJioFc 

h = 

h 

e - 

[48] 


The last equation is necessarily thus written because not h but h/e can 
be directly measured. 

The calculation of the precision index of *So is even more complicated 
than Eq. 44 would lead one to believe. In the process, one noimally 
substitutes for R 0) k, h, and N 0 the values given by Eqs. 45 to 48 and 

1 Birge, R. T., Am. Phys. Teacher , 7, 356 (1939). 




212 


THE PROPAGATION OF PRECISION INDEXES 


follows up with the standard procedure discussed earlier, 
obtained by the substitution is 




The equation 



8. Use of the Law of Propagation of Precision Indexes in Planning a 
Precision Experiment. When it is desired to obtain U with a certain 
precision, pr, we may use Eq. 33 to calculate the maximum permissible 
values of px and py. Thus, one method of measuring the surface ten¬ 
sion of water, T } makes use of the equation 



where h is the height of rise of water in a capillary tube of internal radius 
r, d is the density of water, and g is the acceleration of gravity. Assume 
that a precision of T is desired such that pr/T = 0.001. We then 
wish to find the maximum allowable precision indexes for r, h, d, and g, 
first to see whether or not they are attainable, and second, in order that 
excessive time, money, and labor are not spent in measuring one or more 
of these quantities to a higher precision than is necessary. By Eq. 33 

To obtain a preliminary estimate, we assume that r, h, d } and g may 
be obtained with equal fractional precision. The maximum permissible 
fractional probable error is then given by 

X = V 4 (y) 2 = 0 0005 t52] 


where X may represent r, h, d , or g. Thus for the approximate consistent 
set of values for r, h, d , and g of 0.3 mm, 5 cm, 1 g/cm 3 , and 980 cm/sec , 
the corresponding probable errors should not exceed 0.0001 mm, 0.02 
mm, 0.0005 g/cm 3 , and 0.5 cm/sec 2 . Ordinarily it would be extremely 
difficult to obtain r and h with this precision. However, d and g may 
both be easily obtained to precisions greater than those specified. Hence, 
d and g may be assumed to be without error in this calculation of per¬ 
missible probable errors for the component quantities. Eq. 51 now re¬ 


duces to 



[53] 
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Assuming that r and h may be measured with equal precision, we now 
have 

^ = 0.0007 [54] 

r h 


It follows that the precision for T that is sought requires probable errors 
for r and h which shall be of the order of 0.0002 and 0.035 mm or less. 

It seems highly improbable that such precisions may be obtainable 
for r and h. A conclusion to be drawn is that the method is unsatis¬ 
factory for obtaining the surface tension of water with the desired pre¬ 
cision. If we still wish to measure the surface tension with a relative 
probable error of only 0.001, some other method such as the pressure- 
drop method should be considered and analyzed similarly. 

9. Summary. When a quantity, £7, cannot be measured directly but 
must be calculated from the mean values of two or more independently 
measured quantities, X and Y say, the precision indexes of U may be 
calculated from those of X and F with the aid of the law of propagation 
of precision indexes. In general, if 

U = f(X, Y) [28] 

the probable error of U, pi 7 , may be obtained by the equation 

pp2 = (S) v * 2 + (jv) p?2 C32] 

and the standard deviation, <tjj, by the equation 

- (ST + (ST [33) 


For special cases of Eq. 28, the corresponding expressions for pu are 
given in Table I. 

TABLE I 

Corresponding Special Forms of Lqs. 28 and 32 


U 

X =fc Y 

XY orf 




It is important to check the independence of the pi<*ci>ion 
the component quantities X and F, for if they are dependent 


indexes of 
in part on 
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the same measurements, Eqs. 32 and 33 are not valid. The law of propa¬ 
gation is also valuable in planning precision experiments. If U is de¬ 
sired with a certain pp, we may, assuming X and F to be of equal rela¬ 
tive precisions, calculate, from Eq. 32, maximum allowable values for 
Px and py. Then, knowing the approximate values of px and py, we 
can tell which quantities may be measured roughly, which more care¬ 
fully than usual, and generally, whether the experiment is a good one 
or a poor one for obtaining U with the desired precision. 


PROBLEMS 


1. A length G f approximately 10 cm is measured several times with the aid of a 
calibrated scale. It is concluded that the probable error of the mean of the readings 
taken at one end of the length is 0.03 mm; of those at the other end, 0.05 mm. What 
is the probable error of the mean of the length determinations? 

2. Show that Eqs. 19 and 20 serve as propagation equations for the case where 
U = X/Y. Do not use Eqs. 32 and 33. 

3. The probable error of a single reading with a given voltmeter is 0.20 volt; the 
corresponding quantity for a given ammeter, 0.015 amp. What are the percentage 
probable errors of single determinations of wattages of lamps at their rated wattages, 
obtained from readings on these instruments for the case of (a) a 500-watt, 115-volt 
lamp; (/>) a 60-watt 115-volt lamp; (c) a 60-watt, 32-volt lamp; and (rf) a 60-watt, 
8-volt lamp? 

4. Assuming the curves of Fig. 2 of Chapter IV to have geometric slopes of ap¬ 
proximately one and one-half respectively at points p and q, determine the relative 
precisions with which the physical slopes at these points may be determined. As¬ 
sume that lines ab and dc are approximately equal in length and that the actual 
probable errors for all length measurements are equal. 

6. The relation between resistivity and temperature for polished tungsten follows 
closely the law 



Granted that p„, the value at the gold-point, 1336° K is precise, that elsewhere p 
may be so carefully measured that the relative probable error of a single determina¬ 
tion is 0.005%, and that the exponent of T To has a probable error of 0.005, within 
what probable error can a person locate the temperature of a polished tungsten fila¬ 
ment by means of a single resistivity measurement in the neighborhood of (a) 1200° Iv, 
(b) 1800° Iv, and (r) 2500° K? 

6. With what precision may the density of a 10 gm steel bearing-ball of approxi¬ 
mate density 7.85 gm cm 3 be obtained, if the probable error of the determination of 
its average radius is 0.015 mm, and of its mass, 0.05 mg? 

7. The length of a lamp filament of assumed circular cross-section is measured 
with a rule permitting estimations of length to 0.1 mm. As an average of 10 measure¬ 
ments, 273.45 mm with an average deviation from the mean of 0.24 mm is obtained. 
Its diameter, measured in various azimuths at various cross-sections with an instru¬ 
ment permitting estimations to 0.001 mm similarly yielded, as a consequence of 
50 measurements, 0.2550 mm with an average deviation from the mean of 0.0015 mm. 
From a single weighing, its mass is determined as 268.45 mg with an estimated 
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uncertainty of 0.05 mg. Assume the scales for the length and diameter measurements 
exact If the probable-error method is used in reporting precision, what values may 
reasonably be reported for the length of the wire, its cross-section, its radiating 

surface, and its density? . , .. 

8. In a measurement of the index of refraction of a 60° glass prism for the Di line 

(X = 5895.93 A), the data in the table below were obtained. Assuming the scale 
exact, what is the computed index of refraction? Its probable error? (Note that, 
as shown in Eq. 3, the prism angle appears in both the numerator and the denomi¬ 
nator.) 



Measurement of 

Prism Angle 


No. of 
Readings 

Side of Prism 
to Which Telescope 
is Normal 

Mean Scale 
Reading 

Probable Error 
of Individual 
Reading 

10 

10 

Incident 

Emergent 

80° 45' 30" 
200° 23' 45" 

20" 

25" 


Measurement of Deviation Angle at Minimum Deviation 




Mean Scale 

Probable Error 

No. of 

Telescope Position 

of Individual 

Readings 

Measured 

Reading 

Reading 

10 

For undeviated ray 

60° 15'30" 

20" 

30 

For deviated ray 

f,° 45' 20" 

40" 


9 For the degree of dissociation, x, of HI at 629" K, Bodenstein - obtained 
0.1914, 0.1953, 0.1968, 0.1956, 0.1937, 0.1938, 0.1949, 0_1948, 0.1954 and 0.1947. 
The relation between x and the equilibrium constant A, for such a reaction as 



H 2 "b I 2 2H1 



Determine the equilibrium constant for the dissociation of HI at 629° K and its 

P W a Compare the relative precisions of graphically determined geometric and phys- 
ical slopes of curves for the cases where the tangents to the curves form angles 

approximately 0°, 45° and 90° with the x-axis. 

»Bodenutein, Max, Z. physik. Chem., 22, 1 (1897). 
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THE ADJUSTMENT OF CONDITIONED MEASUREMENTS 


i. Introduction. Independent measurements are often made on quan¬ 
tities that are known or assumed to be related according to one or more 
specific laws. Such measurements are said to be conditioned. Their 
means are not necessarily the most probable values of the quantities 
measured. They must be adjusted to conform to the law or laws relat- 
■ns the quantities. Thus, for the three angles of a triangle we may 
obtain as mean values, 30° 2', 00° 2', and 90° T. We could not certify 
such values, however, since the sum of the three angles must equal 180° 
exactly. In general, if k quantities are related by n equations, adjust¬ 
ments are necessary when more than k - n quantities are independently 
measured. 

In this chaptei we consider the problem of adjustment first for a 
simple case and then for the general case, in which the relation between 
the variables is linear. Later we consider eases involving products, 
powers, and more complicated relations. The treatment of adjustments 
here given assumes that the measurements obey the normal distribu¬ 
tion law. It further assumes that the most probable values for the k 
unknown adjusted means are those which yield a maximum probability 
of occurrence for the weighted measured means. In accord with the 
piinciple of least squares (C hap. VI, p. 163), this condition is equivalent 
to applying the condition of a minimum to the weighted sum of the 

squares of the deviations of the measured means from their adjusted 
values. 

2. Equally Weighted Observations of Linearly Related Quantities. 

Consider first, the quadrilateral survey problem of determining the most 
probable values for the elevations of three points B, C, and D above 
a base A. Using the same letters B, C, and I) to represent the eleva¬ 
tions also, let us assume the following independent observations, all of 
equal weight: 


Quantity 

Measurement 

(feet) 

B 

10.0 

C 

18.0 

D 

4.0 

C-B 

9.0 

C-l) 

12.0 

B-D 

5.0 


210 
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T akin g account of the uncertainties of measurements, we may express 
these observations in equation form by 


B 

- 10.0 ft = 

Ai 

[1] 

C 

- 18.0 ft = 

A 2 

[2] 


II 

0 

1 

A 3 

[3] 

B + C 

- 9.0 ft = 


[4] 

C 

— D — 12.0 ft = 

a 5 

[5] 

B 

— D — 5.0 ft = 

Aq 

[6] 


of which the A’s represent the unknown adjustments that are necessary. 
These six observation equations, involving only three unknowns, show 
clearly the need of adjustment. From them, following the least-squares 
principle and making the sum of the squares of the A’s a minimum, we 
shall form three so-called normal equations involving onty B , C, and D 
as unknowns. Their solution will yield the most probable values for 
the elevations sought. 

Before proceeding farther with the special problem, consider the gen¬ 
eral solution. Let there be n linear observation equations, of equal 
weight, involving k (where k < rc) independently measurable quanti¬ 
ties, Q u Q 2} - * -Qfc. Thus, in the adjusted form, they are 

aiQi -f- biQ 2 H- kiQk — X x = Ai 

GL 2 Q\ b 2 Q 2 4" ’ * * k 2 Qk A 2 = A 2 [y] 


flnQl "f* b n Q 2 H" * * ' kjiQlc — X n — A n 

Here X x represents the observed value of (aiQi + b x Q 2 H- kiQ k ), 

etc., and the A’s represent the small unknown adjustments necessary 
for consistency. Comparing Eqs. 7 one by one with Eqs. 1 to (5, we 
see that Qj, Q 2 , Q 3 represent the quantities B , C, D; that the coefficients 
a i , bx, Ci take the values 1 , 0 , 0 ; that a 2} b 2 , c 2 take the values 0 , 1 , 0 , etc. 
It is necessary that all the A’s of Eq. 7 be of the same physical nature, 

since their squares are to be added. 

Maximum probability of occurrence of the observed set of A s re¬ 
quires, as stated, that 2A 2 shall be an absolute minimum. Since the 
Q’s are the independent variables, it further follows that 

a(SA 2 ) = d(ZA 2 ) = ^ = d(ZA 2 ) 

dQi dQ 2 dQk 


[8] 
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Considering now only 



rewrite the observation equations as 



OiQi 4- Aj = Ai 

a 2Qi + A 2 = A 2 [10] 


a nQ i + A n = A n 

whore A , replaces (6,Q 2 + • ■ -k,Q h - X x ) etc.' It follows that, as an 
abbreviation, 

d(2A 2 ) d 0 0 

~doT = Wi (Ql 2a + 2Ql2a/1 + 2A2) 

= 2[(2a 2 )Qi + 2ai4] = 0 [11] 

I he summations here as well as those in the following equat ions are strictly 
of the type 2a,a, and 2a,/lBy an exactly similar procedure,we obtain 

(Zb 2 )Q 2 + 2bB =0 

(2c 2 )Q 3 + 2cC =0 

[12] 

(Lk 2 )Qk + 2 A: AT = 0 

These equations are the normal equations for the unknown adjusted 
Q-values and are exactly equal to them in number. Replacing the 
abbreviations A, B,- - K, by their equals leads to the following forms, 
more suitable for computational purposes: 

(2 a 2 )Q l + (Zab)Q 2 + (2ac)Q 3 + • • • (2 ak)Q h - 2 aX = 0 

(Zab)Qi + (26 2 )Q 2 + (2 bc)Q z + • • -(2 bk)Q k - XbX = 0 

(2 ac)Q l + (26 c )<? 2 + (2c 2 )Q 3 +••• (Zck)Q h - 2cX = 0 ^ 


(Xak)Qi 4- (Zbk)Q 2 4- (2c*)Q 3 + ••• (2 k 2 )Q k - 2 kX = 0 

The values for Q lf Q 2} Q k obtained by solving Eqs. 13 simultaneously 
will be the most probable values for those quantities. Inspection shows 
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that Eqs. 13 may be obtained from Eqs. 7 rather simply. To obtain 
the first normal equation, one merely multiplies each of Eqs. 7 by the 
coefficient of its Qi and takes the sum. Similar procedures yield the other 
normal equations. Note that the summations involving the A’s, in view 
of Eqs. 10 and 11, equate to zero. For the worker who has occasion to 
solve numerous sets of normal equations, the mastery of some syste¬ 
matic method of solution, such as that of Gauss or of Doolittle, is recom¬ 
mended. For others, the method of determinants, given m Appendix 1, 

should prove most convenient. 

Returning to the problem of the quadrilateral survey, we find, as a 
result of the specified treatment, that our special-case normal equations 

become 

SB - C - D - 6.0 ft = 0 
— B + 3(7— D — 39.0 ft = 0 [14] 

-B - C + 3D + 13.0 ft = 0 

Note, in this connection, that the A, of Eq. 1 is +10 ft > “ 10 ft ' 
There result, for B, C, and D in order, 9J+ ft, 17 A ft, and 4^ ft, and 

for the A’s, likewise in order, - Yi ft, -\i ft, K ft, ^4 ft, 1 ft, an 
— ft. He who doubts that the above set of A’s possesses the least 

value for 2A 2 is invited to test it against any other set, however obtained. 

Consider as a second case that of the angles of a plane triangle. Let 
the angles be a, 0, and 7 , and their measured values, A, B and C all 
equally precise. What are their most probable values? There are but 
two independently valued angles; the third angle, 7 say, is to be con¬ 
sidered as 180° — a — /3. Our observation equations are, accordingly 


(3 — B = A 2 [I 5 ] 

a - 0 + (180° - C) = A 3 


The normal equations become 


2a + fi + (C - A - 180°) = 0 
a + 2fi+(C-B - 180°) = 0 


whence 


P = 


180° - C - A + 2 B 


180° - C - B + 2A 




a = 


3 
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3 Unequally Weighted Observations of Linearly Related Quantities. 

DrobllX 8 1° U PreV ‘° U u ly COnsidered P' oblem ° f determining the most 
P obable elevations at the comers of a quadrilateral, let probable errors 

be given for the measured quantities. With B, C, and D representing, 

as before, elevations above A, assume as the available data 


Quantity 

B 

C 

D 

C-B 

C-D 

B-D 


Measurement Probable Error 


(feet ) (feet) Weight 

10 0 0.2 25.0 

*8.0 0.5 4.0 

10 0.G 2.8 

0 0 0.4 6.2 

120 0.8 1.6 

50 1.0 1.0 


As shown elsewhere, weights are chosen proportional to the inverse 
squares of the probable errors. The procedure is the same as before, 
except that now we consider in effect the first observation equation 
repeated 25.0 times, the second, 4.0 times, etc. The normal equations 
lor the general case with linear relationships become 


(2wa 2 )Q l + (2t vab)Q,+ - (XwaX) = 0 

(Zwab)Q l + (2< vb 2 )Q 2 +- (ZwbX) = 0 



(Zwak)Q, + (Zwbk)Q 2 4-(SuT.Y) = 0 

In computing the coefficients Zwa 2 , 2wab, etc., of Eqs. 18, a tabulation 
such as that employed in Table I will be found very helpful in the elimi- 
nation of computational errors. 

For our special case of elevations at the corners of the quadrilateral, 
the normal equations involving weights become 


32.2 B - 0.2 C - 1.0D - 199.2 ft = 0 
-0.2 B +11.8(7 - 1.0 D - 147.0 ft = 0 [19] 

— 1.0/? — l.GC + 5AD + 13.0 ft = 0 


Solution of Eqs. 19 yields 9.80 ft, 18.30 ft, and 4.84 ft for B, C, and D. 
1 liese values differ appreciably from those obtained on the basis of equal 
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TABLE I 

Illustrating a Convenient Checking Arrangement for Use in Finding the 
Coefficients of the Normal Equations (Three in Number as Illustrated) 

for Weighted Conditioned Measurements 


wa 

waa 

wab 

wac 

waX 

Sums 

25.0 

25.0 

0 

0 

t 

250.0 

275.0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

-6.2 

6.2 

-6.2 

0 

-55.8 

-55.8 

0 

0 

0 

0 

0 

0 

1.0 

1.0 

0 

-1.0 

5.0 

5.0 






224.2 

Totals 

32.2 

-6.2 

-1.0 

199.2 

224.2 

wb 

wbb 

wbc 

wbX 

Sums 

0 


0 

0 

0 

0 

4.0 


4.0 

0 

72.0 

76.0 

0 


0 

0 

0 

0 

6.2 


6.2 

0 

55.8 

62.0 

1.6 


1.6 

-1.6 

19.2 

19.2 

0 


0 

0 

0 

0 






157.2 

Totals 


11.8 

-1.6 

147.0 

157.2 

wc 

wcc 

wcX 

Sums 

0 



0 

0 

0 

0 



0 

0 

0 

2.8 



2.8 

11.2 

14.0 

0 



0 

0 

0 

-1.6 



1.6 

-19.2 

-17.6 

-1.0 



1.0 

-5.0 

-4.0 






-7.6 

Totals 



5.4 

-13.0 

-7.6 
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4. Observations of Nonlinearly Related Quantities. In a large per¬ 
centage of cases, conditioned quantities are related by nonlinear equa¬ 
tions. Four examples may be cited. (1) The first concerns C 2 , the sec¬ 
ond radiation constant; h, Planck’s constant; c, the velocity of light; 
and k, Boltzmann’s atomic constant; which are related by the equation 

C 2 = J [20] 


Although all four quantities may be independently measured, the values 
of only three may be independently specified for a consistent set of the 
constants. (2) The second concerns the four independently measurable 
quantities: n, the porous plug effect; 7, the ratio of the two specific 
heats; (dT/dv) p : and (dp/dT) v , where T, p, and v have their accustomed 
significances; so related by the equation 

7-1 T - v(dT/dv) p 

M 7 T(dp/dT) v 1 J 


that only three of the quantities may be independently specified. Al¬ 
though T and v are also independently measurable, they may be ob¬ 
tained so accurately, relative to the other four constants, that they do 
not enter into any question of adjustments but serve to represent states 
to which adjustments between those four may be ascribed. (3) The 
third concerns the independently measurable quantities: h , Planck’s 
constant; e, the electronic charge; /?//, Rydberg’s constant for the iH 1 
atom; c, the velocity of light; and m 0 , the rest-mass of the electron; 
which are related by 

h / 2?rVZ 2 V* 



RhC 


- 

Wo/ 



As will be noted in one of the problems, the adjustments that seem to he 
required in this particular case are so great as to cause concern regard¬ 
ing methods of measurement and theoretical relations. (4) The fourth 
involves the specific heat quantities: c p ; c v ; y; and T(dp/dT) v (dv/dT) p , 
a quantity equal to the universal gas constant R for the case of an ideal 
gas; which are related by the two equations 




and 


[24] 


OBSERVATIONS OF NONLINEARLY RELATED QUANTITIES 223 


The method of adjustment 
treatment of case (I) above, 
vation equations 




for nonlinear cases is well illustrated by a 
Here we conveniently write as our obser- 


1 +Ai 


Y = 1 + A 2 
■A 2 

Y = 1 + a 3 

A3 



1 + A4 



where the X’s and the A’s have the significance given earlier in this 
chapter. Assuming the A’s to be small in comparison with unity, we 
write Eqs. 25 in logarithmic form, thus: 

In A _ in fc - In X, = A, 

Ai 



In — = In k — In X 3 — A 3 
In h -f- In c — In k — In X 4 = A 4 



It should be noted that the A’s, as well as all the other members of 
Eqs. 26, are numerics . 1 That these A’s shall all be of the same physical 
nature is important, since otherwise, the summation 2A 2 can not be 
applied in an adjustment. 

Consider next the weights assigned to Eqs. 26. Generally, certain 
probable errors will be given for the X’s; if not, weights are assigned 
arbitrarily. With probable errors given, the corresponding probable 

1 In order that “In h - In X” shall be a numeric and that both h and Xi shall be 
quantities possessing physical dimensions it is evident that the logarithms of h and 
Xi shall contain, in addition to the logarithms of their respective numerics, log¬ 
arithms of the units in which the quantities are expressed. These additional terms 
cancel when the difference of the logarithms of the quantities is taken. In all natural 
equations involving logarithms of physical quantities, something like the foregoing 
will always enter to make the checking of units possible. 
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errors for the In X’s follow at once. The principles of propagation of 
precision indexes indicate that 

Px x 

P(Ln xo — 

Ai 


[27] 


„ _ Vx K 

P(ln X t ) ~ ~7T 

A 4 

The inverses of the squares of these probable errors are the weights 
sought. With weights once assigned to Eqs. 20, we follow the procedure 
leading to Eqs. 19, and obtain 

(wi w 4 ) In h -f- (w 4 ) In c — (w 4 ) In k 

— ( W\ In X\ w 4 In X 4 ) = 0 

( w 4 ) In h + (ivo -f a> 4 ) In c — (w 4 ) In k 

— (w 2 In X 2 -f w 4 In X 4 ) = 0 [28] 

— (te 4 ) In h — (?e 4 ) In c + (ie 3 + w 4 ) In k 

— (w 3 In X 3 — w 4 In X 4 ) = 0 

Using “observed” values for h, c, k, and c 2t l namely 

Quantity Value 

h 6.0283 X 10 -27 (1 =fc 0.00013) erg sec 

c 2.99770 X 10 10 (1 =fc 0.000013) cm/sec 

k 1,3803 X 10~ 1G (1 ± 0.00023) erg/K° 

c 2 1.432 (1 d= 0.002) cm K° 

we obtain for the respective weights of their logarithms, 

—yf—y 

0.00023/ ' V0.002/ 

[29] 

= 240 : 24000 : 80 : 1 

A great variation in the weights is to be noted. Substitution in Eqs. 28 
leads to 

241 In h + In c - In k - (240 In X x + In X 4 ) = 0 

In h + 24001 In c - In k — (24000 In X 2 + In X 4 ) = 0 [30] 

1 Physics Staff of the University of Pittsburgh, Outline of Atomic Physics, New 
York, John Wiley & Sons, 1937, 2nd Ed., p. 391. 


w 1 : wt : w 3 : w 4 


_ /—!—y y_ i ~ 

V 0 . 00013 / Vo.ooc 


000013 
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— In h — In c + 81 In k — (80 In X$ — In X±) = 0 


from which we obtain 

h = 6.6283 X 10 -27 erg sec 
c = 2.99776 X 10 10 cm/sec 
k = 1.3804 X 10 “ 16 erg/K° 


[30a] 


c 2 = 1.4394 cm K° 

Because of the very low weighting of X 4 , the observed value for c 2 , 
the values of h, c , and k are not appreciably changed in the adjustment. 
This might have been concluded at the beginning and we might as well 
have computed c 2 in accord with Eq. 20 and taken that as the adjusted 
value. The value to be thus computed is 1.4396 cm K°, only greater 
by 2 in the fourth decimal place. As will be seen from the discussion 
of the short method of the following section, the actual labor of cairy- 
ing out the final computations may be reduced considerably. 

One point of general importance in addition to that of the method of 
adjustment follows from the foregoing discussion. It is that, if one or 
more of the X's is so highly weighted as to “swamp” the weights of the 
others, those highly weighted values may well be accepted as fixed and 

not susceptible of adjustment. 

Sometimes it is not apparent at once how to adjust the given data 
so that the A’s directly involved in any adjustment will always bo of 
the same nature. Consider the second example cited above. Let the 
quantities directly measured and for which we have probable errors be 
M, y, (dT/dv)„, and (dp/dT) „. The simple procedure here is to intro- 

y — 1 

duce functions of the latter three quantities, II for ~ , J f° r ^ — 

v(dT/dv) p , and K for T(dp/dT) v . The principles of propagation of 
precision indexes permit the determinations of probable errors for H , 
J , and K. Eq. 21 may now be rewritten as 

M = f [31] 

and, as in Eq. 20, adjustments are now possible for the quantities enter¬ 
ing Eq. 31. Given the adjusted values for H, J, and K } the procedure 
for finding the adjusted values of 7 , (dT/dv) p , and ( dp/dT) v is obvious. 
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Let us also consider the fourth example cited above for which we have 
to adjust four independently measured values connected theoretically 
according to two relations. Here we write as our observation equations 



Evidently A 3 differs in physical nature from the other A’s and some 

change must be made. The simplest thing is to revise Eq. 34, writing 
it as 

c p M$Cv == A 3 c„ = A r 3 [30] 


of which M 3 c v is to be treated as a Q-term of Eqs. 7 and not as an A r -term. 
Since both sides of Eq. 34 were multiplied by c v in obtaining Eq. 30, 
the A 3 compared with the left side of Eq. 36 is as much an infinitesimal 
as is A 3 compared with 7 . Further, since this c,„ like the c„ of Eqs. 33 
and 35, is an assumed adjusted value, the weight that will be assigned 
to Eq. 36 will be (1 /c v pm 3 ) 2 . We may now proceed to the adjustment 
of c p and c v as desired, using Eqs. 32, 33, 35, and 36. 

5. Short Method for a Common Type of Adjustment. Where all of 
the quantities to be adjusted or functions of them taken singly can be 
related linearly in a single equation and where each measured value is 
a separately measured value obtained for one of the quantities to be 
adjusted, a certain- simplification of procedure is possible. As such a 
case consider the adjustments for the quantities in the equation 


2tt 5 k 4 
15 h 3 c 2 



of which <j represents the fourth power radiation constant (often re¬ 
ferred to as the Stefan-Boltzmann constant), k the Boltzmann atomic 
constant, h Planck’s constant, and c the velocity of light. For these 
equations we have the values 1 given in the upper half of Table II- 
If one substitutes the given values for k , h } and c of Eq. 37, he will 

1 Physics Staff of the University of Pittsburgh, Atomic Physics, New York, John 
Wiley & Sons, 1937, 2nd Ed., pp. 389-391. 
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obtain 5.660 X 10 -5 erg/(cm 2 sec K° 4 ) for a, a value which does not 
check with the stated observed value and shows the need of adjustment. 

TABLE II 


Certain Quantities and Functions and Their Values for Use in Illustrating 

a Short Method for a Common Type of Adjustment 


Quantity or 
Function 

Value 

Logarithm of 
Numeric 

c 

2.99776 X 10 10 (1 ± 0.000013) cm/sec 

10.47680 

h 

6.6283 X 10“ 27 (1 ± 0.00013) erg/sec 

27.82140 

k 

1.3803 X 10" 16 (1 ± 0.00023) erg/(molecule K°) 

16.13997 

<r 

5.735 X 10 -5 (1 db 0.0020) erg/(cm 2 sec K° 4 ) 

5.75853 

2tt 6 /15 

40.803 

1.61069 

A 


20.65709 

Xi 


5.75853 

x 2 


79.46420 

x 3 


63.44012 

D 


-0.00576 


Of the values reported, it is seen that the fractional probable error 
for c is so small compared with that for <x that c, because of its “swamp¬ 
ing effect/’ may be treated as exact in the adjustment process. Rear¬ 
rangement of Eq. 37 yields 

1 2t 5 

log <j + log h 3 + log — 4 = log — - log c 2 [38] 

fc 15 

which takes account of the stated “swamping” precision of c and may 
be identified term by term with 

Qi + Q 2 + Q 3 — *4 [39] 

of which the separate Q ’s are to be viewed as the quantities needing 
adjustment. 

A stated condition for the type of adjustment being considered as¬ 
sumes for the observation equations, Eqs. 7 

Qi — Xi = Ai 


Q 2 — X -2 — A 


O 


Qs — X 3 — A 3 


[40] 
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With weights w u w 2l w 3 , these lead in the regular manner to normal 
equations which when solved yield 

Qi = Xt + — D 

U> 1 


Q2 — X 2 4- D 

iv 2 


[41] 


of which 


B = 


and 


Q3 — X 3 -|- D 

w 3 

?/>l W 2 W 3 

w iw 2 -f- w 2 w 3 -f- u' 3 wt 


[42] 


^ — A (A 1 + X 2 4~ X 3 ) 


[43] 


D represents the discrepancy for which adjustments must be made. 
Ih(‘ fractions B/w u B/w 2 , and B/w 3 must and do add up to unity. 
I he manner of obtaining from Q u Q 2t etc., the desired adjusted values 
for the original quantities in any individual case will be obvious. 

In accord with the above, the abbreviated method of adjustment for 
quantities whose functional relation is expressible by a linear equation 
consists of (1) selecting the necessary functions Q lf Q 2 , etc., for each 
quantity and the form of the linear relation, (2) determining the weights 
Wl > w2 ’ an(1 ^3 to be ascribed to the values X u X 2 , etc., determined 
experimentally or otherwise for the linearly related functions or quan¬ 
tities, (3) determining the discrepancy, Z>, to be adjusted among the 
lincaily related functions, (4) splitting up the discrepancy into compo¬ 
nent paits which are proportional to the reciprocals of the computed 
weights, (5) applying these component parts to the appropriate X u * 2 , 
etc., values, and (0) computing the adjusted values for the quantities 
whose functions were related linearly. 

Applying the outlined procedure to the adjustment of <r, h , and k, 
need for which was indicated above, we note that step (1) has already 
been carried through above and that the functions which have been 
selected as Qj, Q 2 , and Q 3 of Eq. 39 are in order log <r, log / 1 3 , and 
log (1 /k A ) and that log (2tt°/15c 2 ) has been represented by A. Apply¬ 
ing step (2) we obtain for weights W\, w 2 , w 3 of X\, X 2f X 3 the relation 


iv 1 w 2 w 3 


= (0.0020) 2 : (3 X 0.00013) 2 : (4 X 0.00023) 


_ J_ A 

“ 31*31*31 


[44] 
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Since the last three members of this equation sum up to unity, it follows 
that, in order, they represent the values of B/w u B/w 2} and B/w 3 as 

they appear in Eqs. 41. For step (3) the necessary data are listed in 

the lower half of Table II, and the value to be computed for the dis¬ 
crepancy D in accord with Eq. 43 is seen to be —0.00576. Following 
step (5), the partition of D into components in proportion to B/w iy 
B/w 2) and B/w 3 yields in order —0.00464, —0.00019, and —0.00093. 
These applied to X i} X 2 , and X 3 in accord with Eqs. 41 yield 

Qi = 5.75389 

Qo = 79.46401 [45] 

Qs = 63.43919 

Step (6) leads to 

a = 5.674 X 10 -5 erg/(cm 2 sec K° 4 ) 
h = 6.6277 X 10~ 27 erg sec [46] 

k = 1.3810 X 10 -G erg/(molecule K°) 

While probable errors for each of these three values may be determined 
by the method that follows, it has not been so done here. Note, how¬ 
ever, that the adjustment for a is about 5}^ times greater than the 
indicated probable error of the observed value and that the adjustment 
for k is twice the probable error. The situation leaves doubt as to 
whether or not the adjustment is advisable. 

6. Probable Errors of Adjusted Observations. The solution of 
Eqs. 18 leads to the following expression for Qi: 

'ZwaX ’Zwab • • • Xwak 
ZwbX Xwb 2 • • • Xwbk 


'ZwkX 2 wbk • • • 2wA* 2 

2 wa 2 2 wab • • • 2 wak 
2 wab 2 wb 2 • • • 2i obk 


2 wak 2 wbk • • • 2 wk 2 

where a lt a 2 ,• • are complicated but easily derivable in terms of the 
coefficients of X lf X 2f • • X n appearing in the summations 2 waX, XwbX, 
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and their minors, etc. It follows that 


PQi = ^ 2 Vx? + « 2 2 P.y 2 2 H- <*n 2 Px n 2 [48] 

and likewise for the probable errors of the other Q’ s. 

For the simple case, already treated, of the elevations of three corners 

of a quadrilateral above the fourth, where the observations are all of 
equal weight, we have 


SB C D (. X\ — X 4 + X$) = 0 


B -\- SC D ( X 2 + X 4 + X 5 ) = 0 [49] 

~ B ~ C + SD — (X 3 — X 5 — X 6 ) = 0 

There follow 

B = h x i + l x 2 + \x 3 - \x 4 + \Xq 

c = \X\ + \X 2 + \X 3 + \X A + ix 5 [50] 

D = JX, + \X 2 + ±X 3 - \X 5 - \Xq 


where X u X 2t etc., stand for the readings 10.0 ft, 18.0 ft, etc. It follows, 

in accord with the principles of propagation of precision indexes for 
sums, that 



Further, since the probable errors of all the A r, s are the same, we also 
have 






Assuming 0.G ft as the probable error for each of the six measurements, 
the probable error for the adjusted values for B, C, and D is found to 
be 0.4 ft, a value less than the assumed 0.0 ft. 

7. The Present (1940) Status Relative to the Evaluation of the Con¬ 
stants of Atomic Physics. The constants particularly under considera¬ 
tion here are the electronic charge, c, the rest mass of the electron, m 0 , 
and Planck’s constant, h. Many of the measurements of atomic physics 
involve functions of these three quantities. For example, Rydberg’s 
constant for an infinite mass, R x is defined by 



2 ir 2 e 4 m 0 
ch*e o 2 



of which c represents the velocity of light. While Rydberg’s constant 
is among the quantities most precisely determined, the precision for c 
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is still higher. Usually both but sometimes only the latter is treated 
as exact when adjustments involving them are undertaken. 

Adjusting observed data in the field of atomic physics to obtain con¬ 
sistent values has attracted the attention of many physicists. Among 
them we cite Birge, 1 Bond, 2 Dunnington, 3 DuMond, 4 and Darwin, 5 since 


TABLE IV 


Auxiliary Constants Used by Dunnington in IIis Study of Atomic Constants 


[See Table III] 


Symbol 


Description 


F 

c 

P 


r/p 


J?in 
It o 
k a 

k\ 


I* a rad ay in international coulombs/ gm. equiv. 
\vt. 

Velocity of light in cm /sec 

Conversion factor from N.B.S. int. to abso¬ 
lute ohms 

Conversion factor from N.B.S. int. to abso¬ 
lute amperes 

Conversion factor from N.B.S. int. to abso¬ 
lute amperes 

Conversion factor from N.B.S. int. to abso¬ 
lute volts 

Rydberg constant for II 1 in cm -1 

Gas constant in ergs/(mole K°) 

Ratio of mass spectrograph to chemical 
atomic \vt. 

Ratio of ruled grating to Siegbahn wave¬ 
lengths (Bearden) 


Value Used 


96494.0 db 1.5 
(2.99776 ± 0.00015) X 10 10 

1.000485 ± 0.000007 

0.999970 zb 0.000020 

0.999926 dz 0.000020 

1.0000411 dz 0.000022 
109677.76 dz 0.05 
(8.3136 dz 0.0010) X 10 7 

1.000275 dz 0.000020 

1.00203 d= 0.00002 


r* 

h' 


Rydberg constant for infinite mass in cm" 1 
Arbitrarily adopted value of Planck’s con¬ 
stant in erg sec 


109737.42 dz 0.06 


6.6100 X 10- 2V 


their contributions are basic to the present discussion. References to 
other work will be found in the paper by Dunnington. Altogether 
Dunnington lists results from eleven types of measurements (Table III) 
involving c, h, and m 0 and functions of them as subject to adjustment. 

1 Bilge, R. T., Ret*. Modern Phys ., 1, 1 (1929); 13, 233 (1941). 

2 Bond, W. N., Phil. Mag., 10 (1930); 12 (1931). 

3 Dunnington, F. G., Rev. Modern Phy*., 11, 65-83 (1939). 

4 DuMond, J. W. M., Phys. Rer., 66, 153 (1939). 

5 Darwin, C. G., Proc. Phys. Soc., 62, 202-09 (1940). 
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Darwin includes the determination of as a twelfth. In Table III 
it is shown also just how these measurements involve the e , h, and m 0 
and also certain other experimental constants whose values (Table IV) 
are ordinarily accepted as exact to a higher order of certainty. The 
experimental values with their probable errors as recorded might be 
used, as some have been, to obtain adjusted least-squares values in 
accord with the method described above. Before so doing it seemed 



Fig. 1. A Birge-Bond diagram for testing the consistency of experimental data con¬ 
cerned with the atomic constants e, h, and mo. The meanings of e„ and n are stated 
in the legend of Table III, where the data for this graph are to be found. 

wise to Dunnington, as it had to others before him, to test for consist¬ 
ency. Assuming the highly precise value for R„ as fixed, it is evidently 
possible to eliminate e or h or m 0 from the expression given in the third 
column of the table and to modify the experimental values accordingly. 
If, for instance, the expression obtained by electron diffraction, namely 

- (-Y = (1.00084 ± 0.00058) X 10" 8 csu [54] 

e \m Q / 

is so treated and m () , with the aid of Eq. 53, is expressed in terms of c, //, 
and accepted values for and c (Table IV), one obtains 

4r = (0.25558 ± 0.0000(5) esu [55] 

h yi 

If further, one substitutes an approximate rounded value, say 
6.6100 X 10 -27 erg sec, for h, he obtains an approximate value, e n , for e. 
Making this substitution, Eq. 55 yields 

r n = (4.7964 ± 0.0019) X 10 -10 esu 


[56] 
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as shown for the seventh item in the last column of Table III. This 
procedure of first eliminating m 0 and then substituting a rounded value 
for h' has been followed by Dunnington. Further, he has presented 
the series of e n values obtained in a Birge-Bond diagram (Fig. 1), in 
which e n is plotted as a function of n, the power of h corresponding to a 
power of unity for e in the various expressions similar to Eq. 55. 

I he half-lengths of the lines of spread associated with any one point 
on the Birge-Bond diagram represents the uncertainties of the com¬ 
puted en S. Should the values have been satisfactorily consistent all 
points would have fallen on a single average horizontal line or so near 
that their lines of spread would have crossed or nearly crossed it. This 
is very far from being the case. There are three groups of values each 
of which separately seems to have external consistency. Whether or 
not the whole group may be said to have external consistency as that 
is defined in C hapter \ III is left for a problem to be found at the end 
of this chapter. To some, adjustments for a case such as this is without 
much meaning. Dunnington and others on this basis have sought for 


possible errors of theory or for faulty experimental procedure. 

With A j, A 2 > Ax, etc., as the experimental values of Table III, Eq. 54 
may be rewritten as 


, h , e 

In —hi hi — = In .4 7 
c ~ m 0 



If, further, approximate rounded values //', e', and m ' 0 are introduced, 
we may rewrite Eq. 57 as 



A(h/c) Y 
h'/c' )_ 



A(e/m 0 ) Y 
e'/m'o ) _ 


and, since the A terms will be very small quantities, as 


In A 7 [58] 


A(h/e) j A(e/m 0 ) 

+ 2 ~ , , = In A 7 - In 


//' 


h'/e' 


e'/m' 0 


(e'm' 0 ) H 


[59] 


Darwin showed that if the A terms were assumed to represent coordi¬ 
nates and we write 


A(h/e) 
h'/e' ~ X 

[CO] 

A(e/m 0 ) 
e'/m'o y 

[61] 

Ae 

v = z 

[02] 

* -f hu = &7 ± AB 7 

[63] 


our Eq. 57 reduces to 
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of which B 7 , representing the right-hand member of Eq. 59, and A B 7f its 
computed uncertainty, are both small and dimensionless. The other ten 
equations similar to Eq. 63 have similar small values for their B’ s. 
All are simple and none involves more than two of the unknowns. The 
actual magnitude of the AB’s will depend on accepted values for P&, 
e.g., 0.95. A certain convenience of treatment follows, due to the pos¬ 
sibility of thinking of the x , y , z quantities as space coordinates and of 
the AB’s as defining slab-shaped regions in this space to which the equa¬ 
tions predict probable limitations of actual values for x, y, and z. For 
further details the reader is referred to the original article. After a dis¬ 
cussion of the discrepancies, Darwin singled out items 1, 10, and 12 of 
Table III as most likely correct and from these three alone concluded 
that the mast probable values for the quantities desired are 

e = 4.8025 X 10“ 10 esu [64] 


= 1.7591 X 10 7 emu 


[65] 
m 0 

h = 6.6243 X 10 -27 erg sec [66] 

A satisfactory adjustment of the discrepancies has not been found. 

8. Summary. If k quantities are known or assumed to be related by 
n equations, and if more than k — n of the quantities are measured 
independently of one another, the means of the independent sets of 
measurements are no longer the most probable values of the quantities 
measured but must be adjusted to give values consistent with respect 
to the n conditioning equations. The adjustment procedure when the 
quantities are linearly related and the measurements are of equal weight 
consists of the following steps: 

(1) Write in their adjusted forms n observation equations similar to 
the following two 

aiQi + 5iQ 2 + * *' k i Qk — A i = Ai 


O.2Q1 + ■+■ • * 'koQk ~~ A 2 — A2 


[7] 


of which the Q’s are the related quantities; the A’s the independently 
observed values for functions of these quantities related as shown by 
the various constant coefficients a, b, c, • • -k; and the As the necessary 
adjustments. 

(2) Multiply each of the n observation equations by the coefficient 
of Qj in that equation and add the n resulting equations to obtain the* 
first normal equation 

(2a 2 )Q, + (2 ab)Q 2 4-(2 ak)Q k - 2aA r = 0 

The summations involving the A’s are zero. 


[13a] 
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(3) Repeat step (2) k - 1 times, substituting in turn, however the 
coefficients of the other Q< s to obtain altogether k normal equations. 

(4; Solve the k normal equations simultaneously to obtain the ad- 
justed values of Q u Q 2r • -Q km 

(5) Obtain the probable errors of the adjusted quantities by applying 
Eq. 48. ' 1 J b 

When the independently observed values X,, X 2 , • • • have the weights 
w,, w 2 ■ • -, the procedure is identical with that above, except that the 
first observation equation is multiplied by w u the second by w 2l etc. 
I lie normal equations then have the form 

(W)Q, + (2wab)Q 2 +■■■ (2wak)Q k - 2 waX = 0 


[18] 


(2wa£)Qi + ( 2wbk)Q 2 H-( 2wk 2 )Q k - 2 wkX = 0 


Adjustment procedure when the quantities are nonlinearly related 

depends on the type of relationship. No general rules can be set up. 

It is necessary, in any case, to write the observation equations in such 

a form that the differences between the observed and adjusted values 

are in the same units for all the quantities to be adjusted, since the 

squares of these differences are to be added and the sum made a 
minimum. 

^ hoie all of the quantities to be adjusted or functions of them taken 
sin R 1 v (, an be related linearly in a single equation and where each meas- 
uied value represents a value obtained for one of the quantities to be 
adjusted, a much shortened procedure is possible. With the quantities 
oi functions arranged as a sum in the equation of condition that must 
be satisfied, one substitutes measured values and computes a discrep¬ 
ancy which is to be eliminated. The adjustment is completed by divid¬ 
ing up this discrepancy among the various quantities or functions in 
inverse proportion to their weights. 

lo obtain the probable errors and other precision indexes of the ad¬ 
justed quantities (1) the solutions for the adjusted quantities, as ob¬ 
tained from the normal equations, are arranged for each as a sum of 
terms each consisting of an exact coefficient and a measured quantity 
with a given precision index, and (2) the principle for obtaining the 
precision index of a sum is then applied. 


PROBLEMS 

1. Find the most probable elevations of B, C , D, and E above A (the lowest) 
when the following observations are made. Assume all determinations to have 
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probable errors of 2.0 ft. What is the probable error of the final determina¬ 
tions? 


B = 102 ft 
C = 500 ft 
D = 150 ft 
E = 80 ft 


C - B = 400 ft 
C - D = 349 ft 
D - E = 72 ft 
B - E = 20 ft 


2 . Let the observed values for the angles of a plane triangle be 60° 10' ± 1 ', 
60° 2' ± 2' and 60° 0'± 5'. What are the most probable values of the angles? 

3 . Measurements of the //-components of the separations of the star images of 
stars a, 0 , 7 , and 5 (indicated in the order of increasing y) are as given below. De¬ 
termine the most probable values of the //-components for these star images meas¬ 
ured with respect to the image of star a. 


Separation 


Distance 

(mm) 


li-a 

y-a 

8-a 


0.003 ± 0.005 
0.219 i 0.004 
0.250 ± 0.007 


Separation 


7 - 0 
b-(i 

8- y 


Distance 

(mm) 

0.150 ± 0.003 
0.193 ± 0.005 
0.041 d= 0.000 


4 . Given the following assumed measured values for CO_> at 50 A and 100° C: 

= (0.275 ± 0.005) cal, (gm C°) 
c v = (0.191 ± 0.002) cal, (gm C°) 


7 = 1.417 ± 0.005 
dp \ / dv 


dT 


. m 


(0.0815 


0.0040) cal/(gm C°) 


determine the adjusted values for c ; „ c v , and y. 

5 . From direct thermal measurements, with Af7 representing the change in Gibbs' 
function (the chemists’ free energy) for the reaction specified, tlie following have 
been obtained: 


(a) C 2 H 6 ^2C+3H2 Af? = (+8,2G0 ± 200) cal 

(b) 2 H 2 + 2 C ^ C 2 H 4 Atf = ( + 15,820 ± 300) cal 

From equilibrium constant determinations, the following has been reported: 

(c) C 2 H 6 ^ C 2 H 4 + H 2 A G = (+23,330 d= 10) cal 


Though some uncertainty has been expressed as to the justification for adjustment 
here, we are justified in using the data conditionally. What, in view of relation c, 
are the most probable values of A(7 for the reactions a and 6 / 

6 . Do the data of Table III satisfy either the Rossini and Deming or the Birge 
test for external consistency as set forth in Chapter \III? Making use of the 
X 2 -procedure, determine the probability of occurrence of the e n values of that table 
°n the assumption of an expected normal frequency distribution. 

7 . Using the method employed by Darwin to obtain the needed simplified ob¬ 
servation equations, determine the adjusted values for c, e/mq, and h which follow 
from standard procedure. What are their probable errors? 



CHAPTER XI 


LEAST-SQUARES EQUATIONS REPRESENTING 

OBSERVED DATA 


1. Introduction. Of the many products of least squares, that which is 
most valued is the method which it provides for the determination of 
the best equation of a specified type to represent observed data. Al¬ 
though strictly covered above under the most general case of the Ad¬ 
justment of Observations, the method, because of its importance, is 
reconsidered here in a fashion more directly applicable to the determina¬ 
tion of least-squares equations. 

Often the constant appearing in a desired equation is important for 
the operation of an instrument or the application of a principle. In 
other instances it stands for a constant of nature and represents the 
goal of an experiment. Particularly in this latter case there seems 
justification for the accuracy which the least-squares method yields. 
Examples of such constants are the photoelectric constants h/e and 
co/e of the Einstein equation 



the first radiation constant (often called the Stefan-Boltzmann con¬ 
stant), d, appearing in the fourth-power radiation equation 

\n(R = \na + 4 (In T) [2] 

and the gravitational acceleration of a freely falling body, g , as it ap¬ 
pears in the well-known equation 

gt 2 

s — So + Vot -f — 

When one relies chiefly upon the eye in fitting a curve to plotted 
data, a tendency, difficult to overcome, is that of giving undue weights 
to the end points of the plot even though it is understood that the inter¬ 
mediate points are equally reliable and should be given equal weight. 
This tendency is particularly undesirable in the numerous cases where 
the extreme points are such because of added difficulties experienced in 
making observations in their regions and the regions beyond. By the 
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• method of least squares, however, one may give either equal or unequal 
weights, as desired, to the various points of the plot. 

Granted the type of equation to be used and the weighting of the 
data, there is no prospect for the obtaining of a more satisfactory equa¬ 
tion than that which the least-squares method yields. There is, however, 
one drawback to its general use, and that is the great amount of labor 
which it ofttimes but not always entails. For this reason it may often 
be supplanted, with some slight sacrifice of confidence in the result, by 
one of the substitute methods of Chapter III combined with the method 
of successive approximations. 

The method of least squares does not indicate the best form of equation , 
whether linear , or quadratic , or of other type , for the representation of given 
data. At most , it yields the most probable values for the constants entering 
an equation of an assumed form , whatever that form may be. In line with 
this, one sees possibilities of many least-squares equations for the same 
given set of data, each being a best representation for its own type of 
equation. Of these, the actual form selected, as noted in Chapter III, 
will generally depend upon theoretical considerations or the will or the 
intuition of the worker. 

In this chapter we discuss particularly the theory and the process for 
cases where y = fix) takes the form of a straight line or a parabola, 
simple cases to which many others may be reduced. Shortened methods 
for special conditions, probable errors of constants determined by least- 
squares methods, and a criterion for closeness of fit of a least-squares 
equation are also considered. Special attention is directed, in case com¬ 
puting machines are not available, to the time saved when starting with 
an assumed approximate equation. 

2. The Straight Line with Liability of Error Limited to the Dependent 
Variable. The constant which describes the variation of the resistivity 
of a metallic element with temperature at high temperatures is an im¬ 
portant characteristic of the metal which helps to distinguish it from 


rp ^ 

other metals. It is represented by — — 

p (11 


and is obtained from a plot 


of log p = / (log T). Data of this kind for molybdenum, 1 as taken from 
Fig. 1 of the paper referred to, are given in Table I and Fig. 1. 

Here we seek the least-squares equation for a straight line to repre¬ 
sent the data just referred to. Conveniently representing log T by x 
and log p by y, the form taken by the equation is 


y = a + bx 

of which b is the constant in which we are the more interested. 


1 Worthing, A. G., Phys. Rev., 28, 190 (1926). 
# 
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In accord with the least-squares principle, or, what is the same, the 
maximum probability principle, the line desired is a line characterized 
by a minimum for the sum of the squares of the deviations of the plotted 
points from it. A difficulty appears at once. Shall distances be taken 
at right angles to the line? If so, the equation obtained will apply only 
to the particular arbitrary coordinate scales selected for the figure. 
With any other selection, different values will be obtained for a and b. 
How, in the general case with y and x differing in nature, we may select 
coordinate scales justifying the application of the least-squares prin¬ 
ciple to perpendicular distances between the plotted points and the 
least-squares line will be discussed later. 

Here, following the usual and least arduous procedure, we shall assume 
the deviations, the sum of whose squares is to be a minimum, to be 
those that are strictly parallel to the y-axis. This is equivalent to 
assuming that the ^-measurements are exact and that the values of the 
dependent ?/-variable onty are liable to errors. Now the procedure is 
direct and simple. 

Where y represents values defined by the least-squares equation 

y = a -f bx [4] 

and ijo, the observed values, we seek, as in connection with the adjust¬ 
ment of conditioned observations (see p. 217), to minimize, with respect 
to both a and b , 2(y 0 — y) 2 or what is the same, £(y 0 — a — bx) 2 . 
Where n represents the number of observed points, all assumed deter¬ 
mined with the same precision, there follow 

T"P(2/o - a - bx) 2 ] = 0 [5] 


~[^(//o - a — bx) 2 ] = 0 M 

from which we obtain 

na -f b^x = Zyo ["] 

dZx + bZx 2 = Z.ri /0 [8] 

It is well to emphasize here that in Eqs. 7 and 8, the unknowns are 
a and b, and that the summations involving x and y 0 are known quan¬ 
tities. From these equations, we obtain 



v 2 v 
Zx'Zyo 


v r v r}/ 
w.i l/o 


nZx 2 - 


■2 




nZxy„ - IS.rSyo 
nix 2 - (Zx ) 2 


[10] 
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We may next proceed to tabulate the given values of x and y 0 , to ob¬ 
tain the summations entering Eqs. 9 and 10 to solve for a and b, and 
finally to substitute in Eq. 4 to obtain the relation sought. 

Excepting, however, certain instances where computing machines are 
available, much time may often be saved by first introducing a conven¬ 
ient linear relation 

y' — a' -f b'x [11] 

which represents approximately the relation sought. One then treats 
by the least-squares method the differences A y 0 between the observed 
t/o’s and the y n s given by this assumed relation, to obtain a relation 

Ay = Aa + Abx [12] 

The final desired relation follows at once from Eqs. 11 and 12. 

y = y' + Ay = (a' + Aa) + (b' -j- A6).r = a -f- bx [13] 

We shall follow this plan. With the convenience of dealing with small 
numbers in mind, it is often found desirable, as noted also in Chapter 
III, to replace y or x or both by simple functions of those variables. 
This procedure will also be made use of in what follows. 

Inspection of the x and yo columns of Table I shows that the numbers 
represented by x 2 and xy 0 will be unwieldy. One obvious advantage is 
obtained, as shown in the table, by making the substitution 

x 9 = x - 3.2000 [14] 

and treating the x' of this equation as the x of Eqs. 11 to 13. 


TABLE I 


Data Showing! the Resistivity, p, ok Molybdenum as a Function ok Temper¬ 
ature, T , as Used in Illustrating the Procedure Involved in Finding the 

Least-Squares Equation ok a Straight Line 


T 

(°K) 

P 

0ill cm) 

X 

(log T) 

2/0 

(log p) 

x' 

(x- 3.2000) 

Aj/o 

<!/u ~ //') 

10 f 'x'2 

lOVAi/o 

i/o - y 

2289 

01.97 

3.3590 

5.7922 

+ 0.1590 

-0.0013 

25472 

- 207.5 

-0.0001 

2132 

57.32 

3.3288 

5.7584 

+ 0. 1288 

+ 0.0003 


+ 38.6 

+ 0.0014 

1988 

52.70 

3.2980 

5.7218 

+ 0.0980 

-0.0010 


-158.0 

-0.0006 

1830 

47.92 

3.2625 

5.6805 

+ 0.0025 

— 0.0014 

3906 

- 87.5 

-0.0005 

1489 

37.72 

3.1729 

6.5765 

- 0.0271 

-0.0023 

734 

+ 62.3 

-0.0017 

1286 

32.09 

3.1092 

5.5064 

- 0.0908 

+0.0008 

8245 

- 72.6 

+0.0012 

1178 

28.94 

3.0711 

5.4010 

-0.1289 

- 0.0002 

10615 

+ 25.8 

+0.0001 





0.2027 

-0.0057 

81281 

-398.9 

■ 
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For the convenient approximate solution, we may assume (Fig. 1) 

y' = 5.6100 + 1.150a/ [15] 

For the Ay Q there follows, as also shown in the table 

= 2/o ~ y' = yo - (5.6100 + 1.150a:') [16] 

The quantities now subject to least-squares treatment are the rela¬ 
tively very small numerics x' and Ay 0 . 

In accord with the requirements of Eqs. 9 and 10, we next form the 
squares a:' 2 and the products x'Ay 0f determine the sums 2x', 2Ay 0 , 2x' 2 , 
and Xx'Ayo, and substitute the values obtained in the equations to obtain 
Aa and Ab. So doing leads to 


Aa = 


Ah = 


(81281 X 10~ 6 )(-0 .0057) - (0.2027) (-398.9 X 10" 6 ) 

7(81281 X 10" 6 ) - (0.2027) 2 

= -0.0007 

7( —398.9 X 10 -6 ) - (0.2027) (-0.0057) 

------—-1 = — o on*} 1 

7(81281 X 10"°) - (0.2027) 2 


There follow 


Ay' = -0.0007 - 0.0031a;' 


[17] 

[18] 


[19] 


y = y' + Ay' = 5.6093 + 1.1469x' 


= 5.6093 + 1.1469 (a; - 3.2000) [20] 

Eq. 20 is the least-squares equation which best represents the data of 
Table I and Fig. 1, and 1.1469 is the least-squares value found for the 

T dp 

important constant — — • How well the equation fits the data is shown 

pul 

in the final column of the table under yo — y. That the two end dif¬ 
ferences should be the smallest is a matter of chance. The close agree¬ 
ment leaves little doubt as to the correctness of the assumption that 


T dp . 


P dT 


is a characteristic constant. Just how much of the 1.1469 is 


significant cannot be stated without the treatment of more experi¬ 
mental data. Without doubt the 9 is without real significance. 

With weights assigned, w x for point 1, w 2 for point 2, etc., the pro¬ 
cedure is very similar to that described. Corresponding to Xi, we then 
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3.04 3.12 3.20 3.28 3.36 


x ( = Log T in C K) 

Fig. 1. Graph of log resistivity of molybdenum as a function of log temperature. 
The dashed line represents the assumed convenient approximate relation. The 
XX points represent the differences between observed values and those predicted 
by that assumed approximate relation. The line Ay 0 = f(x) represents the least- 
squares relation for those differences. The full line y = f(x) represents the least- 
squares relation for the original data. 


have, effectively, W\ observations averaging to y j, etc. Simple reasoning 
shows that for weighted observations 


and 


where 



2tc.r 2 Z 107/q — 'Zwx'Lwxyp 

I) 



Xw’Zwxy {) — I'WxXwijo 

7 ) 


D = XwZwx 2 - (2u>.r) 2 


[ 21 ] 

[ 22 ] 

[23] 


3. Procedures Leading to Shortened Computations. Often, but not 
always, the labor involved in least-squares computations may be re¬ 
duced appreciably or greatly by following certain procedures. At least 
four possibilities may be named. Two of them have already been illus¬ 
trated in the preceding section. The first consists of introducing new 
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variables to take the place of those given in the original data. Referring 
to the preceding section, note that the independent variable T was re¬ 
placed by log T — 3.200 and that p was replaced by log p. The gain 
has been twofold, that of obtaining a linear form for the function and 
that of obtaining numbers with reduced magnitudes with which to deal. 
As will be noted in a later section, such a change for the dependent 
variable involves a change of weight. This change, really rather 
unimportant for the case illustrated, was ignored in the application 
referred to. 

The second procedure, also illustrated above, consists of assuming a 
convenient approximate relation between the two variables, taking the 
differences between the observed and the resulting corresponding com¬ 
puted values of the dependent variable, and applying the normal least- 
squares procedures to such differential values. See in this connection 
Eqs. 15 and 16 above and the column of Table I headed A?/o- The gain 
has been a very considerable reduction in magnitude of the numerics 
involved. 


The third procedure consists in making slight adjustments to yield 
values for the dependent variable corresponding to more convenient 
rounded values for the independent variable. In making such adjust¬ 
ments, the definite trend of the relation should be observed. How this 
may be done and the gain obtained thereby is well illustrated in Table II. 
A rough plot of the data indicates a straight-line relationship with an 
expected rate of variation of a v with pressure of about 1.34 X 10 -8 
K°~ 1 /mm-Hg. Applying this common rate to all values of a v , the 
indicated adjusted values follow directly. When, further, the first two 
named procedures are applied in addition, the problem of finding the 
desired a v will be found to be quite brief and simple. The carrying 
through of such a computation is left for a problem to be found at the 
end of the chapter. To what extent adjustments of this type may be 
safely made mav well be left to one’s common sense. Any error intro- 
duced on this account into the result for the case considered is obviously 

inappreciable. 

The fourth procedure consists in taking or selecting data in advance 
for least-squares treatment in such manner that successive values for 
the independent variable shall differ bv the same constant amount, say 
10 cm, 5 min, 40 ft/sec, etc. This procedure is only applicable where 
the dependent variable may be equated to a polynomial such as 


..3 


ij = a -j- bx -f- car + dx 

involving the independent variable only to the third power (at present) 
or less. When such is the case, it is possible, with change of variable, 
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TABLE II 

Portion of Data Reported by Beattie, 1 of Massachusetts Institute of 
Technology in a Determination of the Constant Volume Coefficient a v 
. of Nitrogen at 0° C and Zero Pressure and Certain Adjustments of That 
Data to Yield More Convenient V vlues for Least-Squares Treatment 


Unadjusted 

Adjusted 

V 

10 7 a. 

P 

10 7 a. 

mm-Hg 

K° _1 

mm-Hg 

K °-i 

998.28 

36740.48 

1000.00 

36740.71 

749.66 

36707.01 

750.00 

36707.06 

599.59 

36686.30 

600.00 

36686.36 

449.42 

36666.57 

450.00 

36666.65 

333.11 

36651.84 

330.00 

36651.40 


1 Beattie, James A., Report on the Thermodynamic Temperature of the Ice Point, from a symposium 
on Temperature , It * Measurement and Control in Science and Iruiustry f New York, The Reinhol Pu 
lishing Corporation, 1941, p. 85. 

to make use of the procedure developed by Baily and the tables com¬ 
puted by Cox and Matuschak whose uses are described below. 

4. Nonlinear Forms of Equations That May Be Readily Reduced to 
Linear Forms for Least-Squares Treatment. Of these we cite Cauchy s 
two-term equation for the index of refraction of a substance 


b 

71 = a + ^2 

[24] 

the common decay law 

[25] 

I = Ioe' ax 

the normal frequency distribution of errors 


— n~X“ 

y = 

[20] 


the law for the variation of field strength in the neighborhood of an 
infinitely long, uniformly charged circular wire of unknown diameter 

E(r + a) = b [ 2 "J 

and the potential energy for a system of two bodies experiencing mu¬ 
tually attracting and repelling forces 

V = ar ~’ 


n 


- br n 


[28] 
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The first, of these is actually linear in n and 1/A 2 though not in n and A. 
The otheis may be changed to the following forms for convenience: 


In I = In 7 0 — ax 

In y = In y 0 — h 2 x 2 
b 

— = r + a 


[29] 

[30] 

[31] 


Vr m = a - br m+n [32] 

in which forms the equations are linear in terms of the functions multi¬ 
plying the constants sought and may be treated accordingly. 

6. The Straight Line through the Origin, y = bx , with y Only Liable 
to Error. Sometimes y is known to be proportional to x. Then the best 
value for the single constant b in the relation 


y = bx [33] 

is to be determined. This is the case for the radiancy of a black body 
where 

(R = <tT 4 [34] 


which takes the form of Eq. 33 when T 4 is represented by x. Here we 
imagine 7 ,J plotted as abscissas and (R as ordinates. The procedure 
outlined above, on the assumption that a is zero, and that y , or (R , only 
is liable to error, leads to a simple expression for b. 

Substitution of a = 0 into Eqs. 7 and 8 leads to two expressions for 
b, namely 


and 





The former depends on the partial derivative of a summation with 
respect to a and is meaningless here since a is a constant and no such 
partial derivative is possible. The latter, however, depends on a deriva¬ 
tive with respect to b of the summation 2(// 0 — bx) 2 based on the con¬ 
dition that a is zero. It gives a best value for b for the condition that 
the graphed straight line must pass through the x, y origin. Cor¬ 
responding to the original specified condition, Eq. 35a is the one to be 
used. 

For unequally weighted pairs of values, we have 



2wxy 0 
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For the constant o-, we have accordingly, for the case of equal weights 
given to observation equations of the type of Eq. 34 


txrt 4 

2(T 4 ) 2 



Eq. 35a forms the basis for much work in Correlation. (See Chap. 
XII.) 

6. Change of Weights Implied by a Change of Variables. Instead of 
following the procedure outlined in the preceding section for obtaining 
a most probable value of the first radiation constant <r, at least two other 
reasonable methods maj r be followed to yield least-squares values. The 
three methods will normally yield different best values unless account 
is taken of the variation in method. 

First, let Eq. 34 be rearranged to read 

In (R = In a + 4 In T [38] 


We may imagine In (R as the dependent variable plotted as a function 
of In T, the independent variable whose values, as those for T 4 in the 
preceding section, we shall treat as free from error. 

Accordingly we seek the least-squares line whose slope is 4, and in 
particular its intercept on the In (R axis. Equating b of Eq. 7 to 4, 
yields 


whence 


2yo 42 x 

a =- 

n 




In (R - 42 In T 
n 


[39] 

[40] 


a value which is also obtained by merely averaging the values of In <j 
as given by Eq. 38 and then taking the antilog. 

Second, we may rearrange Eq. 34 to read 


^ + q L a [41] 

rji 4 1 J 

Similarly, we may imagine (R/T 4 the dependent variable plotted as a 
function of the independent variable 1/7’ 4 which is assumed free from 
error. Now we seek the intercept for the least-squares line with a zero 
slope. Equating the b of Eq. 7 to zero leads at once to 


a = - 2?/o 
n 

[42] 

1 (H _ _ 

* - n 2 r 4 

[43] 

% 


or 
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This value is a straight average of the dependent variable. The solution 
obtained by equating the b of Eq. 8 to zero is to be disregarded for a 
reason similar to that given in connection with Eq. 35. 

That the procedures based on Eqs. 34, 38, and 41 will lead to different 
values for a is evident. The explanation is that they tacitly ascribe 
different weights to the observed pairs of 01 , T values. Assuming values 
lor T precise, consider what changes in weights have been tacitly given 
to the measurements of 01 in shifting from the procedure based on Eq. 
34 to that based on Eq. 38. The answer is indicated by Eq. 33 of Chap¬ 
ter IX which expressed the law of propagation of probable errors and 
other precision indexes for the general case. Simplified for the present 
case of only one independent variable, it states that 


_ (In 01) 1 

V ' nm = ~^~ V(R = m PlR 


[44] 


Since weights vary inversely as probable errors squared, we have 

(«W)i (pj01) 2 2 011 2 ptf., 2 


(^In (ft)2 (P(R/01) 


[45] 


& 2 2 P<R? 

Assuming that all p^s are equal, this means that the corresponding 
values of In 01 should be weighted as the squares of their own 01' s. If 
such weighting is applied when starting with Eq. 38, and one is able to 
consider the fractional deviations (01 — 01o)/01—01 represents a least- 
squares curve value and Ol 0 a corresponding observed value—so small 
that their second order effects may be ignored, it is possible to show that 
the a obtained is the a of Eq. 37. To the extent that those second 
order effects, namely those due to the higher order terms ignored when 
In [1 — (01 — 01 0 )/01] is replaced by (01 — 01 Q )/01 in the series expan¬ 
sion, are not negligible, the a-’s based on Eqs. 34 and 38 will differ. 

In accord with the above, when the shift was made above to Eq. 40 
and its In 01 's were treated as equally weighted, the weights tacitly given 
to the 01 's (not In Ol's) varied as 1 /01 2 . 

Similarly consider the weights tacitly given to the measurements of 
01 when the procedure initially based on Eq. 34 was changed to that 
based on Eq. 41. Here we obtain 


and 


P((Jl/T *) 

d{(K/T 4 ) 1 

[46] 

den Pdl r PR 


C P*/T*h 2 7 1 . 8 

[47] 

l w ((R/T*)\ 2 

(Pv/T 4 )! 2 T 2 s Ab , 2 
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Assuming as before that all p^’s are equal, means that corresponding 
values for (R/T 4 should be weighted according to their own T 8 . The 
weights tacitly given to values of (R (not (R/T 4 ) when the shift was made 
above to Eq. 41 were as 1/T 8 . That weighting (R/T 4 as indicated above 
actually gives the same value for a as does Eq. 37 may be shown. With 
such weights given, as may be verified with the aid of Eq. 7 modified 
to include weights, we have, corresponding to Eqs. 42 and 43 

Zw(R/T 4 

a =-— [48] 


and 


a = 


2 w 
2 T 8 (R/T 4 _ 
2 T 8 ~ 


2 (RT 4 
2 (T 4 f 


[49] 


the latter of which is identical with Eq. 37. Equivalence for the end 
results may be shown but not so simply when the first and second pro¬ 
cedures are similarly tested. However, the conclusion follows that with 
proper account taken of changes in weight for the dependent variable, 
it matters not, where only one constant is involved, in which of many 
interchangeable forms the data are given least-squares treatment. 

The foregoing does not indicate in any way that, in an actual deter¬ 
mination of a , equal weights should be given to the (ft’s rather than the 
In <ft’s or the (R/T 41 s. 

7. Probable Errors for the Least-Squares Constants of a Linear 
Equation Obtained from a Set of Equally Weighted Points. Here one 
may follow the procedure of section 6 of Chapter X, p. 229, for obtaining 
the probable errors of adjusted measurements. In so doing, he should 
note that the symbols of this chapter which correspond to Qi, Q 2 , ct, b 
and X of Chapter X in order are a, b, 1, .r and y. For the least-squares 
straight line, that treatment yields 


and 






wSx 2 - (2x) 


•> Puo 


I n 

^ n2* 2 - (2*) 2 


Puo 


[50] 

[51] 


If p v 0 is not known, it may be computed, using the defining equation 


Puo = 0.675 


^2(y 0 a 


— a — bx) 


n - 2 


fy 

= 0.675 yj- 


O/o ~ a - bx) 


[52] 


n 


Expressions for p„ and pi, not involving p y 0 may be obtained by com¬ 
bining Eqs. 50, 51 and 52. More simply they may be obtained by 

1 See footnote on page 1G7. For the more precise form, the factor n - 2 replaces 
the more common n - 1. The reason is due to the fact that two arbitrary parameters, 
a and b, are involved. (See Birge, I*hys. Rev., 40, 207 (1032).) 
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applying directly the defining equation for a probable error, Eq. 24 of 
Chapter VIII, p. 194. Assume that n straight lines are drawn to con¬ 
nect the n observed x, y, points with the point x y, that the probable 
eriors for the a,- and b t - for these lines are proportional to l/(x,- — x) 
and thus that the weights to be attached to the a ( and the 6,- vary as 
(Xi — x) . One then obtains for a and b the values given in Eqs 9 and 
la Applying Eq. 24 of p. 194 for the case of y 0 ’s of equal weight 
(nx — , etc.) we then obtain 



8. The Parabola, y - a + bx + cx 2 with y Only Liable to Error. 

1 he procedure here is quite like that for the straight line. The assumed 
equation is 

There follow </ = a + 6x + cx 2 [55] 


d 

^ [2(2/o — a — bx — cx 2 ) 2 ] = 0 
d r 

^ [2(yo - a - bx - cx 2 ) 2 ] = 0 [56] 

<9 

^ [2(?/o — a — bx — cx 2 ) 2 ] — 0 


an -f bZx + c'Zx 2 = 2y 0 
aZx + bZx 2 + c2.r 3 = 2xy 0 [57] 

aZx 2 -b b2x 3 4- cZx 4 = Zx 2 y 0 

J [Xx 2 2x 4 - (2x 3 ) 2 ]2y 0 - [2x2x 4 - 2x 2 2x 3 ]2xy„ 

a =- T __ + [2x2x 3 - (2x 2 ) 2 ]2x 2 y 0 | 

[2x 2 2x 4 — (2x 3 ) 2 ]n — [2x2x 4 — 2x 2 2x 3 ]2x ) 

+ [2x2x 3 - (2 x 2 ) 2 ]2x 2 J 

| [2x 2 2x 3 - 2x2x 4 ]2y 0 - [(2x 2 ) 2 - «2x 4 ]2.n/o 1 

b = i______ + [-x2x 2 - n2x 3 ]2x 2 i/oj 

| [2x 2 2x 4 - (2x 3 ) 2 ]« - [2x2.r 4 - 2x 2 2x 3 ]2x | 

i + [2x2x 3 - (2 x 2 ) 2 ]2x 2 | 


[ 58 ] 
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f [2x2x 3 - (2x 2 ) 2 ]22/o - [«2x* - 2x2x 2 ]2x2/ 0 } 

_ I + [nS* 2 - (2x) 2 ]2x 2 2/ 0 | 

° [2x 2 2x 4 - (2x 3 ) 2 ]n - [2.r2x 4 - 2x 2 2x 3 ]2x 

H- [2x2x 3 - (2x 2 ) 2 ]2x 2 

The denominators for the last three equations arc identical. 

Excepting certain types of cases as will appear in a later section, the 
least-squares method for equations other than the straight line are gen- 
ally quite laborious. Here, however, much more than in the straight- 
line case, much time is saved if a convenient approximate solution is 
assumed and the least-squares principle is applied to the differences be¬ 
tween the observed values and those predicted by that assumed relation. 

9. Application of the Least-Squares Parabolic Equation to the 
Smoothing of Tabulated Data. In Chapter I it was indicated that a 
certain smoothing relation (Eq. 1) was based on the least-squares prin¬ 
ciple. It is now possible to show how the equation, namely 


2/ = ~ [17?/o + 12(2/+! 4- 2/-i) ~ 3(2 /+2 4- 2/— 2 )] 

do 



may be derived. Here 2/0 is the tabulated unsmoothed value correspond¬ 
ing to x 0 . Similarly 2 /+ 2 > 2/+i> V -1 > ant ^ 2 /—:2 are th c tabulated unsmoothed 
values corresponding to x 0 4- 2Ax, x 0 + Ax, x<> — Ax, and x 0 — 2Ax, 
and y is the smoothed value which is to replace 2 / 0 - Cnly five points on 
an assumed plot representing the data are used. 

For the process of smoothing at any particular x, say x*o, much time 
is saved by a change of coordinates. Let x be replaced by x [ = (x — 
Xo)/Ax]. In the new coordinate system, the points to be treated are 
(2,2/ +2 ), (l,2/+i), (0, 2 / 0 ), (— 1»2/— 1 )> an d (-2,2/_ 2 ). The least-squares 
relation sought is 

y = a 4- bx' 4- ex' 2 [01] 


Since we are concerned only with the smoothed value for y at x 0 , we 
need only to evaluate a of Eq. 58, which is the smoothed value sought. 
Evaluation, seeming long at first sight, is actually made short by the 
change from x to x' and y to y '. It will be found that 2x' = 2x 3 = 0, 
that 2x /2 = 10, and that 2x' 4 = 34. There follows 

(34022/ - 02 x'y - 1002 x ,2 y) 


a = 


(340 X 5 - 0 X 0 - 100 X 10) 

— [17 2/0 4- 12(.v+i + 2/-i) — 3(2/+2 4" 2/— 2 )] 
35 


[(32] 


m 


which is the relation sought. 
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10. The Polynomial with x-Values Equally Spaced and Exact A 

most comprehensive study of this particular field has been presented by 
nge, 1 Condon, 2 and Birge and Shea. 3 A generalized, compact formula 
developed by them is presented in the paper last referred to. It will be 
discussed later. First, however, we shall discuss certain results and pro¬ 
cedures which by virtue of the computations reported by Baily 4 and by 
Cox and Matuschak 5 are more readily applied. 

The treatment of polynomials here given refers only to equations of 
the form 


y = a 4- bx -{- cx 2 + dx 3 4- [64] 

Fin ther the assumption is made and if necessary the data are so manip¬ 
ulated (1) that the observed values of y are equally weighted, (2) that 
the successive values of .r differ by a constant, (3) that the values of x 
are exact, and (4) that the values of x are arranged symmetrically with 
respect to a central value. Illustrative of the simplifying effects of 
these conditions, it has already been shown in the preceding section 
t at, undei the stated conditions, the rather formidable general expres¬ 
sions for the constants a, b, and c (Eqs. 58) of the least-squares equation 
for the parabola 

y = a 4- bx 4- cx 2 [55a] 


reduces to rather simple expressions. 

1 leatments in accord with the above-stated conditions usually require 
a change of independent variable from x to X. Thus, where x represents 
one-half the sum of the initial and final values of .r, Ax is the common 
x-interval, and the number of pairs of values is odd, X is defined by 



In case n is even, X is similarly defined by 




Thus defined, both X Q and X e are whole numbers with both negative 
and positive values. For the odd series the values arc 


3, 2, — 1, 0, 4" 1, 4~2, 4~3, 4~ • * • 

for the even series 

“5, —3, —1, 4-1, 4-3, 4-5,4- 

1 Birge, Phijs. Ren., 13, 360 (1919). 

2 Condon, E. I '., Vnin. Calif. Pub. in Math., 2, 55-56 (1927). 

3 Birge, R. T., and Shea, J. D.; Ibid., pp. 67-116. 

4 Baily, J. L., .bin. Math. Statistics, 2, 355 (1931). 

6 Cox, G. C., and Matuschak, Margaret, J. Phijs. Chem ., 45, 362 (1941). 
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A simplification of Eq. 58 follows because now all summations of odd 
powers of X are equal to zero. As a result the a, 6, and c of Eq. 58, 
now the a', b', and c', of an equation in X similar to Eq. 55a, reduce to 


LX 4 


a = 


nLX 4 - (LX 2 ) 2 


Zy- 


LX 2 


nLX 4 - (LX 2 ) 2 


2X 2 y 


= k 3 Xy - k£X 2 y 


2\2 


b' = 


n2X 4 - (2X 2 ) 
n2X 2 2X 4 - (2X 2 ) 3 


r, XXy = k 2 XXy 


[67] 

[ 68 ] 



n 

n2X 4 - (2X 2 ) 2 


2X 2 y - 




The k’s are seen to be functions of X only and as such have been tabu¬ 
lated by Baily not only for the polynomial ending with X 2 but also for 
polynomials ending in X and X 3 . The various k’s entering and their 
designations by subscripts are shown in Table VI of Appendix 2, and 
values for these k’s, as computed by Cox and Matuschak, for 2 < n < 51 
are presented in Tables VII and VIII. Though given to eight significant 
figures in these two tables, usually a much smaller number will suffice. 
Where the tables are applicable, computations are very greatly reduced 
by their use. 

Illustrating the applicability of the method, let us consider certain 
data concerning a laboratory experiment relating to gravitational accel¬ 
eration published by Pugh. 1 Though originally presented for least- 
squares treatment by a different procedure, they suffice well for our 
purposes. Using a falling-body apparatus with spark recording of 
positions at the ends of successive 1/30 sec intervals, the data given in 
the first two columns of Table III wore obtained. The equation relat¬ 
ing distance and time is 

s = So + V () t + \ (jl 2 [3] 


in which s and t replace the y and x of the preceding discussion. In 
accord with Eq. 66, the origin for the time axis is shifted to midway 
between the ends of the 7th and the 8th time intervals, and the interval 
of time that corresponds to a change of 1 in A r is 1 00 sec. In the new 
coordinate system, in which t is replaced by t -\- XAt 2, Eq. 3 becomes 


s = (s 0 + v 0 t + \gt 2 ) T (aT \(jtAt)X H- [^g(At) 2 ]X 2 [70] 

The successive terms in parentheses in order correspond to the a', b ', and 
c' of Eqs. 67 to 69 and Table VI of Appendix 2. Since the acceleration g 


1 Pugh, E. M., Avu D hys. Teacher , 4, 70 (1936). 
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TABLE III 


Illustration of the Application of Baily’s and Cox and Matuschak's 
Method to Falling-Body Data Presented by Pugh 1 for Use in Determining 

the Gravitational Acceleration g 


t 

in units of 
1/30 sec 

.s 

in cm 

X 

X 2 s 
in cm 


1 

11.86 

-13 

2,004.34 

c' = k^X 2 s - k£s 

2 

15.67 

-11 

1,896.07 

k b = 21,462,912 X 10" 12 

3 

20.60 

- 9 

1,668.60 

k A = 13,950,893 X lO" 10 

4 

26 69 

- 7 

1,307.81 

= 1.40585 cm 

5 

33.71 

- 5 

842.75 

k^Zs = 1.26993 cm 

6 

41.93 

- 3 

377.37 

d = 0.13592 cm 

7 

51.13 

- 1 

51.13 

A< = l Ao sec 

8 

61.49 

+ 1 

61.49 

8c' __ cm 

9 

72.90 

3 

656.10 

Q - ,. a2 “ 978 * 6 2 

(A*) 2 sec 2 

10 

85.44 

5 

2,136.00 

11 

99.08 

7 

4,854.92 


12 

113.77 

9 

9,215.37 


13 

129.54 

11 

15,674.34 


14 

146.48 

13 

24,755.12 


Totals 

910.29 


65,501.41 



1 Am. Phys. Teacher, 4 , 70 (1936). 


only is desired, it suffices to solve for c', using the tables, and then for 
g, whose value is given by 



Some of the details are shown at the right in Table III. As is evident, 
the procedure is not unduly prolonged. 

In many instances data that may well be given least-squares treat¬ 
ment similar to that above are subject to the theoretical condition that 
the constant a of Eq. 64 is zero. One may be tempted to meet this 
difficulty in the application of the Cox and Matuschak tables by dividing 
both sides of Eq. 64 by x, treating y/x as z in the equation 

z = b + cx + dx 2 4- [72] 


and then finally returning to the original form of Eq. 64. In so doing, 
however, the original (/-values will no longer have their original equal 
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weights, but instead will be tacitly given weights proportional to their 
corresponding x 2 ’s. Tables similar to those by Cox and Matuschak 
computed for the case of a = 0 would be much appreciated. 

Consider next the more general formula of Birge and Shea, already 
referred to. Their form for the polynomial equation of the jth degree is 

y = ooj + aijX + a 2 jX 2 H- [73] 


Curiously, all coefficients, can be worked out as definitely 

related to final coefficients of the form ajj of which the j is not always 
the j of the polynomial sought. For the coefficient ajj they found 


(2u — j)\(2j + 1)! yy 
(2u + 3 Hr Dm 2 


Vr + (— 1 ) J y~r 

or 

2/o 



(-1 ) 8 (u - r)\(2u - s)\(j + s)\ 



where n represents the number of observations, u equals J/£(n — 1), 
and r and s are parameters with successive values differing by unity. 
For n odd, the lowest value of r is 0; for n even, Yi. In case j is even 
and r is 0, but for no other case, the central member of the above ex¬ 
pression for ajj is y 0 rather than the expected 2 y 0 . 

For the condition j = 2, the coefficient (Z 22 may be obtained from a 
direct application of the above equation, and the remaining coefficients, 
Oq 2 and ai 2 , may be determined from the following 





[75a] 


For other values of j the reader is referred to the original paper. 

11. Least-Squares Procedure for Relations Other than Those Ex¬ 
pressible in Power Series. Generally, a procedure involving an assumed 
approximate relation as illustrated above for a simple straight line will 
simplify and considerably shorten the computations connected with 
many least-squares determinations. In fact, in some instances, pro¬ 
cedure is extremely difficult or even stopped where such advantage of 
an assumed approximate relation is not taken, this is the case where 
the equation does not form or cannot be converted into a power series 
with the constants sought or some functions of them as the coefficients 
of the power terms. Illustrating such a relation, we have 

y = a sin (to/ -f- b) 


[76] 
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with a and b to be determined. This relation will be treated in some 
detail in the following section. Another relation is 


y = a 

with a , b, and c to be determined. 




y f(x) be a desired relation of known form involving undeter¬ 
mined parameters a , b, c, etc. Let y' = /(.r) represent the approximate 
equation. We may write, in accord with Taylor’s expansion 


A y = y - y' = 



Ac + • • • [78] 


In evaluating the partials, as suggested by the primes, the assumed 
values of a, b, c,- • -, as expressed in y' = /(.r) are used. To illustrate, 
vheie y = fix) takes the forms of Eqs. 7G and 77, we are able, using 
the approximation principle, tc reduce the problems to finding the con¬ 
stants Aa, Ab, and Ac for the following: 


Ay = sin (c ot + b') X Aa + a' cos (cot + b') X Ab [79] 


a . . 1 * i b' In x 

Ay — Aa H —Ab -p— Ac 


x 



The quantities a', b' t and c' are constants, obtainable by one of the 
methods of Chapter III. Ihe equations are linear in A a, Ab, and Ac 
and are subject to standard least-squares treatment. Since the partial 
derivatives involve a', b', or c', it is of importance that the assumed 
relation shall approximate the final relation rather closely. If the first 
approximation is not sufficiently close, a second may be required. 

I he equations yielding Aa and Ab of Ecj. 79 are obtained in a manner 
similar to that yielding Eqs. 9 and 10, from which a and b were obtained 
in the straight-line case. The equations obtained are also similar. 
Where three corrections, as Aa, Ab, and Ac, arc involved, the procedure 
is like that described above for the parabola, and the equations have a 


certain similarity. 

Once Aa, Ab, Ac,’ • • have been determined, the corrected values for 
a, b, c, • • • are obtained readily, since they are merely a' -{- Aa, b' + Ab, 
c' + Ac, • • • 


12. The Sine Curve with Angle Measurements Free from Error. 

The procedure which we shall follow’ here will differ slightly from that 
suggested in the preceding section. It will be simplified to the extent 
that we shall assume an approximate value for the b but not for the a 
of Eq. 7G. 
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TABLE IV 

Showing a Convenient Form for Making Computations, and Sample Compu¬ 
tations Leading to a Least-Squares Equation of the Form y = a sin (cot — e) 

in Accord with Eqs. 81 to 86 

(Certain of D. C. Miller’s ether drift data 1 interpreted as showing azimuthal angu¬ 
lar motion with respect to the ecliptic are here used. As 0.15 X 360° has been 
chosen. 


t 

sidereal 

day 

9 

deg 

VO 

deg 

cos 0 

sin 0 

2/0“ 

deg 2 

I/O COS 0 
deg 

2/0 sin 9 
deg 

cos 0 sin 0 

cos 2 0 

0.00 

-54 

-25 

0.588 

-0.809 

625 

-14.70 

20.22 

- 0.4757 

0.3457 


-36 

-26 

0.809 

- 0.588 

676 

-21.03 

15.29 

- 0.4757 

0.6545 

0.10 

-18 

- 4 

0.951 

- 0.309 

16 

- 3.80 

1.24 

- 0.2939 

0.9044 

0.15 

0 

7 

1.000 

0.000 

49 

7.00 

0.00 

0.0000 

1.0000 

0.20 

18 

6 

0.951 

0.309 

36 

5.71 

1.85 

0.2939 

0.9044 

0.25 

36 

13 

0.809 

0.588 

169 

10.51 

7.64 

0.4757 

0.6545 

0.30 

54 

30 

0.588 

0.809 

900 

17.64 

21.27 

0.4757 

0.3457 

0.35 

72 

26 

0.309 

0.951 

676 

8.03 

21.73 

0.2939 

0.0955 

0.40 

90 

32 

0.000 

1.000 

1,024 

0.00 

32.00 

0.0000 

0.0000 

0.45 

108 

40 

-0.309 

0.951 

1,600 

-12.36 

3S. 04 

-0.2939 

0.0955 

0.50 

126 

32 

- 0.588 

0.809 

1,024 

- 18.82 

2.3.89 

-0.4757 

0.3457 

0.55 

144 

21 : 

-0.809 

0.588 

441 

- 16.99 

12.35 

-0.4757 

0.6545 

0.60 

162 

11 

-0.951 

0.309 

121 

- 10.46 

3.40 

-0.2939 

0.9044 

0.65 

180 

- 5 

-1.000 

0.000 

25 

5.00 

0.00 

0.0000 

1.0000 

0.70 

-162 

-16 

-0.951 

- 0.309 

256 

15.22 

4.94 

0.2939 

0.9044 

0.75 

-144 

3 

-0.809 

- 0.588 

9 

- 2.43 

- 1.76 

0.4757 

0.6545 

0.80 

-126 

-21 

- 0.588 

-0.809 

441 

12.35 

i 6.99 

0.4757 

0.3457 

0.85 

-108 

-22 

- 0.309 

-0.951 

484 

6.80 

20.92 

0.2939 

0.0955 

0.90 

- 90 

-29 

0.000 

- 1.000 

841 

0.00 

29.00 

0.0000 

0.0000 

0.95 

-72 

-32 

0.309 

-0.951 

1,024 

- 9.89 

30.43 

- 0.2939 

' 0.0955 






10,437 

- 22.22 

307.44 

0.0000 

12.0004 


1 10437 X 12.0004 — ( — 22.22)'- 

— = -———-dog = 34.09 

A 307.44 X 12.0004 - ».()(- 22.22) 



10437 X 0.0 - ( — 22. 2 2) (307.4 4) 
10437 X 12.0004 - (-22.22)'- 


rad = 0.0543 rad = 


3° T 


€ = *' + S = 54° + 3° T = 57° T 



34° 5.4' .“in 


( 


360 


sid. day 



1 Pev. Modern Phy». t 5, 203 (1939). 
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Assume the desired form of equation to be 


y = a sin (c ot — e) 


[81] 


where a and 6 are to be determined. From a plot of the data, estimate 
in advance, as is usually possible, an approximate value for e, say e' 
Let 5 represent (c - e'); 0, the angle (cot - «'); and A, the telm 1/a. 
Expansion of sin (Q — <5) in terms of sines and cosines leads at once to 


Ay - sin 6 -f 8 cos 6 = 0 


[82] 


In determining the least-squares equation, A and < 5 , in terms of which 
the equation is linear, are to be evaluated. Regular procedure yields 


^(^ 2/0 sin 6 -|- 8 cos d) 2 = 0 = a minimum 


[83] 


of which ?/o represents measured values corresponding to appropriate 

values of 6. Equating d(f>/dA and d4>/38 separately to zero and solving 
for A and <5 as before, leads to 


A ^Vo 2 ~ 2?/ 0 sin 6 -f- 52 t/ 0 cos 6 = 0 
A2y 0 cos 0-2 cos Q sin 6 -j- <52 cos 2 0 = 0 


A = 


2 ?/o sin 0 2 cos 2 0 — 2 cos 0 sin 0 2 y 0 cos 0 
2 yo 2 2 cos 2 0 — ( 2 ?/o cos 0) 2 


[84] 
[84a] 

[85] 


<5 = 


_ 2 ?/q 2 2 cos 0 sin 0 — 2 y n cos 0 2 y n sin 0 


2 i/o 2 2 cos 2 0 - ( 2 y 0 cos 0 ) 


2 


[ 86 ] 


Insertion of values for A and <5 in Eq. 82 gives the relation sought. In 
case the first estimated e' yields too large a 8, repetition of the process 
with a different e' will be necessary. Table IV, which deals with a 
simple case, shows a convenient form for carrying out the computations. 
Probable errors for a and e may be obtained by following a procedure 
much like that for the probable errors for the constants a and b of a 
straight-line equation. 

13. The Least-Squares Equation of the Type y = a + bx when 
Liability of Error Occurs with Both x and y . Although mathematically 
we may consider x an independent variable with values arbitrarily 
chosen and as such not liable to error, in reality in physical problems, 
such is not always the situation. Frequently neither x nor y can be 
said to be more independent as a variable than the other. Both are 
measured and the values obtained for both are subject to errors of meas¬ 
urement. Consider the ease of the measurement of the temperature and 
the radiancy of a black body for some particular condition of operation. 
Such is the justification for that which follows. 
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Since x and y will generally differ in physical nature, it is necessary 
to treat certain simple functions of these variables rather than x and y 
themselves. These functions must be either dimensionless or expressible 
in the same physical units. Otherwise there seems to be no logical way 
of properly weighting them. Starting with 

y = a + bx [87] 


as the relation sought, we first express x and y , in effect, in terms of 
their probable errors as units, writing 



T x 

= a + bp x — 

Vx 


Then dividing through by a , we have 

pY' = 1 + otX' 




where a, /3, X ', and Y' stand in succession for bp x /a > p u /a, x/p x , and 
y/Py. All quantities are now dimensionless and the probable errors of 
both X' and Y' are unity. 

Imagine a plot showing Y* = f(X') with the same scale (this is im¬ 
portant) for both X' and Y'. The problem is now resolved to that of 
finding the straight line to which U, the sum of the squares of the 
perpendicular distances from the points to the line, is a minimum. 
Standard procedure, using observed values for X' and Y' f yields 



£ 


r\2 


d + ax’ - ?n 


a 


2 + / 3 : 



Application of the least-squares principle, namely, that the partial de¬ 
rivatives dU/da and dl T /dp shall be separately equal to zero, yields 
equations which are to be solved for a and p. If then a, p, X , and Y 
are replaced by their equals in terms of ci, b f x, and y , one obtains ex¬ 
pressions which may be solved to yield the desired values for a and b. 
Differentiations of Eq. 90 with respect to a and to p separately yield on 
slight rearrangement, 


and 




PY') 


A 


r f 





a 


[92] 
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Combining Eqs. 91 and 92, keeping in mind that the summation process 
prevents equating the indicated factors separately to zero, we obtain 

2(1 + aA" - 0 F') = n + a2A" - 02 Y' = 0 [ 93 ] 

Heplacing a, 0 , A" and Y' by their equivalents and solving for a one 
obtains 


« = - Vy - 62 :r) 

/ L 


[94] 


Similar treatment of Eq. 91, together with the elimination of a by means 
of Eq. 94, leads to a second-degree equation in ft, namely 

ft* + ft ( P»/Px) 2 [(Sr)» - ».Sx»] - [(2 ;/) 2 - *2;/ 2 ] 


2 ,' 2 » 


/(2.rw 


[K| 


I < r I s * 94 an(I 95 m ay bo solved to yield the desired a and 6 . For values 
of p x small in comparison to p ?/ , the value of b reduces to that given by 
Kq. 10 , which was derived for the ease where y only is liable to error. 
Similarly the value for a reduces to that given by Eq. 9 . 

Though occasions justifying the application of Eqs. 94 and 95 occur 
latliei often, their use seems to be very infrequent. 

14. Criterion for Closeness of Fit. A\ hen one determines by the least- 
squares method an empirical equation of the form, say 


V = a + bx + cx 


.2 


[55a] 


to represent observed data, certain questions sometimes rise. For in¬ 
stance, is the cx 2 term necessary? Or, should another term dx 3 be added? 
It is obvious that, il y is a single-valued function of x, and there are n 
j)aiis of values given, an equation similar to Eq. 55a containing n terms 
on the right-hand side with n arbitrary constants could be derived which 
would tit the data exactly. Nevertheless, the data may not justify the 
use of more than two or three terms of the power series. For the deci¬ 
sion, a criterion is needed. That which is used, except for certain simple 
cases, is based on Gauss’ mean-square deviation. 

A simple case, such as has just been referred to, arises sometimes when 
the data, y = f(x), are in tabular form with values of y tabulated to 
correspond to equal intervals of .r. As indicated in Table II of Chapter 
III, the successive diflerences may then indicate the form of equation 
which will represent the data suitably. In particular, if the successive 
dilterences of the //th order of y for a constant Ax are constant or vary 
therelrom but slightly and then only in a haphazard manner, the f(x) 
takes the form of a polynomial in x with n as the highest exponent. 
Accordingly, where the original data are such as to yield tabulations 
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of the type referred to, successive differences may indicate just how many 
terms of a polynomial are justified. Where such is the case, this pro¬ 
cedure of obtaining successive differences is the simplest for determining 
how many terms shall be included in the f(x) polynomial. On the other 
hand, such successive differences may leave some uncertainty as to where 
approximate constancy actually occurs, and there may then be need of 
a more positive test as to the number of terms for the best polynomial. 
Of course, this simple test is not applicable at all where the y-values do 
not correspond to z-vallies at regularly spaced intervals, or where the 
equation actually representing the data does not belong to the group 
of equations which can be tested in this manner. 

The Gauss criterion states that the closest fit is possessed by the 
equation that yields a minimum for the quotient obtained when the 
sum of the squares of the deviations (or residuals) of the observed from 
the computed values for y is divided bv the number of observed pairs 
of ( x,y ) values less the number of arbitrary constants involved. In 
equation form, with n as the number of observed pairs and 1:1 the number 
of arbitrary constants or free parameters, the criterion is 



= a minimum 



Application to determine the most suitable equation is not the real 
purpose of this criterion. Rather it is of value in determining which of 
two representations is the more suitable—to answer, for instance, in 
some particular case questions like those asked at the beginning of this 
section. At best the process is likely to be rather long and tedious. 

An interesting application of the foregoing criterion has been made 
by Wensel and Tuckerman, 1 of the National Bureau of Standards at 
Washington, D. C. A published paper on the thermoelectric power of 
rhodium as a function of temperature for the range 850° C to 1350° C 
seemed to show a discontinuity occurring at about 1100° C. As a con¬ 
sequence, the original authors in presenting equations to represent their 
data gave two least-squares relations ot the form of hq. 65a, one for the 
range 850 ° C to 1100° O, the other for the range 1100° C to 1350° C\ 
After reviewing the work, Wensel and Tuckerman decided to apply the* 
Gauss criterion. They com pared the 12-value according to hq. 96 for 

C m 

two least-squares parabolic relations each involving three free param¬ 
eters and each covering one-half the lull range with the 12-value for 
a single parabolic relation covering the whole range. It was resolved 
to the comparison of a fit involving six tree parameters with one involv- 

1 Wensel, H. T., and Tuckerman. L. R, h Vv. Sri. Instrument.*, 9, 2'M <1938;. 
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ing only three. (See Fig. 16 of Chap. II, in which the authors present 
the two points of view graphically.) 

The results obtained by Wensel and Tuckerman are shown in Fig. 2 
and Table V. It is seen that the single parabola covering the whole 
lange yields the smaller value for the criterion expressed in Eq. 96 and 
theiefoie possesses the closer fit. Incidentally it was concluded that 



Fig. 2. Showing deviations (yo - y) between observed and least-squares emf’s for 
rhodium against platinum for cases (A), a parabolic relation for the range 850° C < 
T < 1100° C, (B), a parabolic relation for the range 1100°C < T < 1350° C, 
and (C), a parabolic relation for the range 850° C < T < 1350° C. The results 
are summarized in Table V. 


the supposition of a thermoelectric discontinuity is not justified. Inci¬ 
dentally also, in view of precision index considerations, it would seem 

that the values given in the table for 12, ——-arc not significant 

n — in 

to the extent shown. 


TABLE V 


Showing Certain Details for the Application of the Criterion 
for Closeness of Fit, as Applied by Wensel and Tuckerman 



[The data 

contained are those plotted in 

Fig. 2] 


Case 

n 

No. of 
observations 

m 

No. of free 
parameters n — m 

2 fob - y ) 2 

in Guv) 2 

2(w - y ) 2 

n — rn 
in fiiV) 2 

Two parabolas 

14 

G 

8 

0.0434 

0.00542 

One parabola 

14 

3 

11 

0.0527 

0.00479 


15. Summary. Of the many products of least squares, among the 
most valued is the method it provides for determining the arbitrary 
constants for a best equation of a specified type to represent observed 
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data. The types here considered are limited (1) to those involving two 
variables only, one independent, the other dependent, and (2) to those 
possessing linearly related arbitrary constants or such structures that 
those constants or functions of them may be linearly related. 

For the case where the specified linear relation is given by 


y = a -f- bx 


[4] 


it is common, but not necessary, to assume that the y-values only are 
subject to variation. The condition that the sum of the squares of the 
deviations of the observed y 0 's from the y s given for the same x s by 
the least-squares equation shall be a minimum, leads, when applied, to 
definite expressions for a and b. For equally weighted values of yo, n 

in number, they are 

2.t 2 2?/o - Zx^xyo j-gj 


a = 


n?x 2 - (2x) 2 

n'Zxyo — 2:r2?/o 
b = nXx 2 - (2x0 2 


[ 10 ] 


For i/o-values having varying weights w, the equations become instead 


2te.T 2 2i/n/o — ’Zwx'Lwxy^ 
a = 'Zw'Zwx 2 - (Xwx) 2 

’Zw’Zwxyp — 2mu*2w?/o 
b 2ic2uur — (2 wx)~ 


[ 21 ] 


[ 22 ] 


Many equations may be altered in form to make them effectively 

linear and thus subject to least-squares treatment. 

Disregarding weights one may obtain more than oik cast squaii.^ 

value for a given constant by using the same basic relation expressed 

differently. For the first radiation constant, for instance, we have tor 

the equally weighted forms 

-r«T‘ [37 ] 


° 2 (T 4 ) 2 

2 In ft -42 In T 


= In 


— i 


and 


n 


_ 1 V « 

a r‘ 


[40] 


[43] 


It is shown that, when one shifts fro.. to another of such forms for 

computation purposes, changes of weight have been tacitly given to the 
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different items of data and that, when allowances are made for these 
changes, the same results may be expected by the different procedures. 

Probable errors, p a and p b , may be computed for the constants of 
a least-squares straight line which has been obtained for an equally 
weighted set of points treatment in accord with that shown in Chapter 
X, p. 229, yields /-gp- 

, » ~ ^ - H' *“ |50) 

and 


Pb = 



n 


of which p y0 is given by 


nZx 2 - (2.r) 


Pvi 


[51] 


Vu o = 0.675 



-(//o - a - bx) 2 


n- 2 


[521 


Expressions for p„ and p b} not involving p v() , obtained from Eqs. 50 to 
52 or derived from independent considerations are 


p a = 0.(575 



and 


p b = 0.675 



1 

1" x 2 f - 2 Xijxy + XV 

1 

to 

L X 2 — x‘ 

> 

t 

1 

V 2 - f , 2 


n — 2 

l7* -.P M 



— a 


2 


[53] 


[54] 


The parabola 


y = a + bx + cx 2 [55] 

treated in a manner similar to that for the straight line yields the 
cumbersome expressions of Eqs. 58 for the constants a, 5, and c. How¬ 
ever, when certain conditions are fulfilled these expressions are much 
simplified. 

For the special conditions (1) that the given or observed values of y 
arc equally weighted, (2) that the successive values of x differ by a 
constant, (3) that the values of .r are exact, and (4) that the values of 
x are arranged symmetrically with respect to a central zero value, the 
least-squares equations for the evaluation of the arbitrary constants for 
polynomials, involving .r-terms up to at least the third degree, are all 
greatly simplified. A change of variable from .r to X to meet condition 
(4) is necessary, and to make the difference specified by condition (2) 
the numeric 1 is convenient. For the case that n the number of pan's 
of values is odd or even, X is defined by 


or by 


(-Y. - 

\ AX / od 

(.V. - 

\ Ax 2 / n cv 


[05] 


[ 00 ] 


cn 



I 
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With this change each coefficient of the least-squares polynomial be¬ 
comes expressible as a single term or as the difference between two 
terms, each of which consists of the product of a function of x and a 
summation such as 'Eyo, 2 X 2 / 0 , 2X 2 */ 0 , or 2 X 3 yo. The method of com¬ 
bining the functions of X due to Baily is shown in Table VI of Appendix 
2. Values for these functions of A’’, as tabulated by Cox and Matuschak 
for values of n up to 50, will be found in Tables VII and VIII of Ap¬ 
pendix 2. With the aid of these tables, many otherwise rather formi¬ 
dable least-squares evaluations become rather simple. A generalized 
expression for the coefficients of a polynomial of any degree as developed 
by Birge and Shea is given by Eq. 74. 

In certain instances the equation connecting observed data cannot 
be transformed directly to yield a linear relation connecting the co¬ 
efficients to be determined. In this case with y = f(x) representing the 
desired relation, and a, b, and c the desired coefficients (1) an approxi¬ 
mation y' = /(*) is assumed and (2) the difference (y — y') is then 
developed in accord with Tajdor’s series and treated in the form 

Ay = y - V' = (%) Aa + (g-) Afc + • - [78] 


The correction to an assumed ordinary sine relation then becomes 

Ay = sin (ut -f- b') # X Aa - a' cos (wt + b') X Ab [79] 

of which a' and b' are assumed approximate values for a and b. 

The constants for a least-squares equation of the type 

y = a bx W 

when both x and y are liable to error are given by a solution of the 
simultaneous equations 

[94] 


a = 1 {-U - b2x) 
n 


and 


b 2 + b 


iVy/p^Vx ) 2 - wSx 2 ] - 

2*2 y - u'Zxy 


- (*)’- 


= 0 [95] 


A criterion for closeness of fit for eases in which y only is liable to 
error is contained in Gauss’ mean-square deviation. Where is the 
observed value, y the corresponding least-squares value, n tlu* number 
of observed pairs of values, and m the number of arbitrary constants or 
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free parameters for the equation, the criterion in equation form becomes 



Z(j/o - y) 2 

n — m 


= a minimum 



Of all equations, that which yields the least value for ft is assumed to 
best represent the given data. 


PROBLEMS 

1. Millikan ( Phys. Rev. ,7, 355, 191G, Figs. 5 and 6), in a determination of Planck’s 
constant, h, by the photoelectric method using sodium, found that for certain wave¬ 
lengths of radiation, X, certain stopping potentials, V (actually, as measured, stop¬ 
ping potentials less contact emf between sodium and copper), were required to just 
prevent a photoelectric current in the cell used. From a straight-line plot of V as 
a function of frequency, c/X, he obtained h e, the theoretical slope of the line. This 
he combined with the electronic charge, e, which he had measured otherwise, to 
obtain h, the quantity desired. The data (these values are taken from the curves 
of I* ig. 5, and may not check Millikan’s values precisely) plotted are: 


X V 

(A) (Volts) 

2535 0.520 

3126 -0.385 

3650 -0.915 

4047 -1.295 

4339 -1.485 

5461 -2.045 

Using Millikan’s data and the least-squares method, determine h/e. Then, using 
Millikan’s 1916 value for e, namely 4.774 X 10 -, ° escoulombs, see how closely you 
agree with the value h = 6.56 X 10~ 27 erg sec which he obtained from this par¬ 
ticular set. 

2. One of the best methods of determining the ice point on the Kelvin temper¬ 
ature scale is that of determining for a gas. a, the limiting mean coefficient of press¬ 
ure increase at constant volume on heating from 0° C to 100° C, as the pressure 
approaches zero, and computing its reciprocal. Data for such a computation ob¬ 
tained by Beattie are given in Table II. Using the data there presented as adjusted 
and giving equal weight to each determination of a v and assuming the relation 
a„ = a + F v p , where F v is a constant, compute a least-squares value for a and 
for 7’o. Also determine its probable error. The suggested treatment is somewhat 
different from that actually used by Beattie. Small corrections applied to a v values 
to yield values expected for 1000.00 mm-Hg, 750.00 mm-Hg, etc., and change of 
the dependent variable to a,, less a convenient function, will reduce the labor of 
computation very greatly without affecting the result appreciably. 

3. If the broken line, given by y = ad for the range 0 < 6 < tt/ 2 and by y = 
a(ir-O) for the range ir/2 < 6 < tt, is to be represented as well as possible by the 
single term «isin0, show that the best value for ai is that prescribed for the first 
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term of the Fourier half-range sine series which represents the line. Given that 
instead it is to be represented by 03 sin 30, show that the best value for 03 is then the 
third term of the same series. 

4 . On the basis of least squares, derive the best equation of the type ij = 

4 

^ (dm sin md + b m cos »t 0 ) to represent 20 given values for points throughout the 
ro = 1 

range 0 < 0 < 2ir having equal 0-separations. Assume the y-values to be such 
that the bo/2 term is negligible. (Use if necessary the derivable relation 


S S ' m2 ("" %) = 2 “ ti t,,SJ ( 


2. r \ 
rm — I 
2 p) 


of which p, m, and r are integers.) 

5. Using the smoothed data for ///„ = f{T) obtained in the working of prob¬ 

log (///„) 

lem 2, p. 27, determine least-squares equations of the forms, — - a + 

b log (T/T n ) and — = a + 5-b c ( — ) . A,so usin K tllc “criterion of closeness 

in T n \7 n/ 

of fit,” determine which equation is preferred for representing the data. 

6. Using Halliday’s data as given below (see graph p. 175) showing pulse intervals 
of no a-particle reception from an a-particle source by an a-partiele counter, obtain 
a least-squares equation of the type P = where P represents the probability that 
a pulse interval shall be as long as or longer than t 


Interval, sec 

Probability 

Interval, sec 

Probability 

0 . 0 - 0 .5 

0.3540 

3.5-4.0 

0.0175 

0 .5-1.0 

. 2250 

4.0-4.5 

.0120 

1 . 0 - 1 .5 

.1420 

4.5-5. 0 

.0090 

1 .5-2.0 

. 0960 

5.0-5.5 

.0040 

2 . 0 - 2 .5 

. 0690 

5.5-6.0 

. 0065 

2.5-3.0 

.0350 

6 . 0 - 6 .5 

. 0025 

3.0-3.5 

.0275 




7 . The average barometric pressure and temperature for the summer as a function 

aris are reported (Smithsonian PhysicalTables 7th Ed.) as 


°C 

15.7 


Altitude 

Km 

12 

14 

If. 

15 
20 


Pressure Tcmperat lire 
mm-Hg °C 

-51.0 


151 .2 
111.1 
SI .7 
00.0 
41.1 


-51 .0 
-51 .0 
-51 .0 
-51.0 


of altitude in the region of Paris are rep< 

Altitude Pressure Temperature 
Km mm-Hg 

0 760.0 

2 598.0 7.5 

4 466.6 -3.0 

6 360.2 -15.1 

8 274.3 -29.7 

10 205.1 -45.5 

For a homogeneous atmosphere the expected pressure-altitude relation is given by 

V = 7W 

Because of the temperature variation, a much le tter fit is »l>< allied. using the relation 

p = pul,!*—* + O ~ 1 >'■ "''I 

From a graph showing ln( 1 - p/pn) - /(*'!. "»• '■•"«>» a. ee,,table values for 

A and a. Using the least-squares method, litel a nio-t aeeeptable r.iliu fm ,i. 
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8 . The 1939 determination of the specific heat of water in terms of the 15° C 

calorie at the Bureau of Standards by Osborne, Stimson and Ginnings 1 yielded the 
following: 


T in °C 

cal 

T in °C 

cal 

m gm C° 

C/ ' m gm C° 

0 

1.00762 

55 

0.99919 

5 

1.00392 

60 

0.99967 

10 

1.00153 

65 

1.00024 

15 

1 .00000 

70 

1.00091 

20 

0.99907 

75 

1.00167 

25 

0.99852 

80 

1.00253 

30 

0.99826 

85 

1.00351 

35 

0.99818 

90 

1.00461 

40 

0.99828 

95 

1.00586 

45 

0.99849 

100 

1.00721 

50 

0.99878 




Determine a least-squares equation to represent the above data of the type 

Cj, = a + hr -f C7 2 + dr 3 

where r represents T — 0° C. If a computing machine is not available, round off 
c p values to the fourth decimal place or use only values corresponding to 0° C, 10° C, 
20° C, etc. 

9. The van’t Hoff isochore [In A',,1 = or \ 0 f which 

L <17 P \„ R'r 2 ld(l/T)_\ p R 

Rp is an equilibrium constant, A// the heat of reaction, R the ideal gas constant, 
and T the absolute temperature, is one of the most important equations of chemical 
thermodynamics. Slopes taken from a curve showing In A',, = f(\/T) permit of a 
determination of heat of reaction as a function of temperature. For the reaction 
No ^ 2Ni, Lewis and von Elbe 2 have tabulated published data which in part are as 
follows: 


T in °K 300 400 000 800 1000 1200 1600 2000 

log A';, in A 118.1 86.9 55.8 40.2 30.9 24.6 16.8 12.0 


Derive (1) a least-squares equation showing In K p = and (2) an equation 

showing A// = f(T) for the dissociation of nitrogen. 

10 . C ragoe of the Bureau of Standards (Am. Inst. Rhys. Symposium on Tempera¬ 
ture , etc., Reinhold Publishing Corporation, New York, 1941, p. 104) in a dis¬ 
cussion of the “slopes of R\ isotherms” of real gases calls attention to their 
“importance in atomic-weight determinations, in gas analysis,” etc. He cited certain 
data on nitrogen at 0° C which were obtained by Michels, Woutcrs, and de Boer at 
the van der Waals Laboratory in Amsterdam and presented various least-squares 


1 Osborne, N. S., Stimson, II. F., and Ginnings, D. C., J. Research A 'at. Bur Standards, 23, 197 (1939'. 

2 Lewis, B., and von Elbe, G., Combustion , Flames arul Explosions of Gases, p. 3S2, Cambridge, at 

the University Press, 1938. 
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equations to represent them. The data and one of the equations for all pairs equally 
weighted follow: 


10 5 In 


v_ 

Vo 

pv 

Po 

V 

PoVo 

19.0215 

19.1606 

0.99274 

23.7629 

23.9734 

.99122 

28.4968' 

28.7894 

.98983 

33.1101 

33.4951 

.98851 

37.9526 

38.4409 

.98730 

42.7435 

43.3413 

.98621 

47.4376 

48.1401 

.98541 

52.2160 

53.0328 

.98460 

pv ^ 

pm 

-45.3236 ±0.352) A 

\ v ) 

| -f 0.29885 - 


This equation may be checked rather closely without undue labor by (1) plotting 


In 


pv 

vm 


-'( 5 - 0 - 


(2) obtaining, with the aid of the physical slopes of the 


pv pv 

curve at appropriate points, values of In-and then of In — 


Pot'o 


POVO 




for neigh¬ 


boring equally spaced values of — 1 ^ as 18.10, 22.95, 27.80, etc., and (3) applying 


to such pairs of values the method which makes use of the tables by Cox and Matu- 
schak. What change of weights is involved? Check Cragoe’s equation. 

11. One method of determining the optical constants of a metal consists in deter¬ 
mining the reflectivities of the polished metal for light polarized respectively in the 
plane of incidence, R\\, and perpendicular to that plane, R j.. One of the authors 1 
has done this for tungsten and obtained the following tabulated values. 


Angle of 
Incidence 

Rn 

Rx 

76° 

82.5% 

12.30% 

77 

83.0 

11.00 

78 

84.0 

11.05 

79 

84.5 

11.15 

80 

85.6 

11.00 

81 

80.6 

12.40 

82 

87.9 

14.40 


On the basis of Chauvenet’s criterion two 7?u values have been discarded. The angle 
of principal incidence is the angle for which the ratio R\\ R L is a maximum. Using 
least-squares procedure and the above data, determine the angle of principal inci¬ 
dence, also the angle of principal azimuth which is defined by 


tail" ^ = — 
tin 


for the angle of principal incidence. 

1 Worthing, A. G., J. Optical Soc. Am., 13, 647 (1926). 
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1. Introduction. In tho discussions of Chapter XI leading to least- 
squares expressions for y = /(.t), we tacitly assumed that, for each given 
\aluc of x, there corresponded a single definite value of y. In the 
language of the section about to be developed, we assumed a correlation 
of unity. We now consider cases where y is, in addition, a function of 
other variables which may not be known. In particular we wish to 
determine within what range of certainty a mathematical relation, de¬ 
veloped to express the interdependency of two variables, may be ac¬ 
cepted for yielding definite values for one variable when values for the 
other are given. 

Geneially we speak of correlations between factors, or accomplish¬ 
ments, 01 attributes, or characteristics whose dependencies on one an- 
othei aie only partial. Most often, perhaps, w F e think not so much of 
the physical dependence of these attributes on each other as of their 
dependence on certain other attributes which may only be surmised. 
It thus has meaning to speak of correlations (a) between students’ 
giades in mathematics and in physics (Table I and Fig. 1), (6) between 
the daily temperatures at noon at Pittsburgh and the corresponding 
tempeiatuies for succeeding days at New York, (c) between the heights 
of fathers and the heights of their sons, ( d ) between the average rainfall 
in a region during some one month as June, say, and the average corre¬ 
sponding temperature, (e) between tin; stellar magnitudes of stars and 
their proper motions, etc. 

It is evident from big. 1 that physics and pre-math test grades are 
somehow related, since on the average, students with high math grades 
made higher physics grades than the students with low math grades. 
However, the scattering of the points about the least-squares line which 
has been drawn is very great and cannot be ascribed to random errors. 
In cases like this the variables are said to be stochastically related or 
correlated, rather than causally or functionally related as in Chapter 
XI. Stochastic relationships may be nonlinear as well as linear and may 
exist among three or even more variables. 

In this chapter we treat first the case of two variables assumed 
linearly related. The correlation coefficient, r, is derived and its signifi- 
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TABLE I 

Grades in Beginning Mathematics and Physics at the University 
of Pittsburgh Obtained by a Group of 69 Students 


[The mathematics course preceded the physics course] 


No. 

Pre-Math 

Grades, 

X 

Physics 

Grades, 

Y 

No. 

Pre-Math 

Grades, 

X 

Physics 

Grades, 

Y 

1 

58 

112 

36 

78 

164 

2 

59 

. 141 

37 

79 

134 

3 

63 

113 

38 

97 

215 

4 

58 

161 

39 

83 

204 

5 

50 

134 

40 

96 

243 

6 

81 

188 

41 

91 

184 

7 

55 

120 

42 

83 

129 

8 

78 

143 

43 

82 

167 

9 

76 

200 

44 

77 

200 

10 

80 

232 

45 

96 

158 

11 

91 

157 

46 

60 

200 

12 

74 

143 

47 

86 

247 

13 

47 

113 

48 

69 

115 

14 

90 

202 

49 

80 

173 

* 15 

85 

174 

50 

95 

222 

16 

71 

147 

51 

97 

181 

17 

71 

134 

52 

82 

188 

18 

78 

143 

53 

64 

126 

19 

73 

137 

54 

72 

72 

20 

54 

150 

55 

09 

134 

21 

82 

197 

56 

52 

101 

22 

57 

103 

57 

73 

150 

23 

78 

183 

58 

87 

174 

24 

55 

120 

59 

59 

194 

25 

72 

201 

00 

52 

127 

26 

94 

200 

01 

71 

109 

27 

87 

177 

02 

93 

199 

28 

86 

203 

03 

70 

| 

129 

29 

62 

129 

04 

j 88 

151 

30 

82 

209 

05 

70 

159 

31 

84 

251 

;i oo 

11 

85 

1 

100 

32 

92 

225 

i 07 

j 82 

i 

202 

33 

72 

104 

j 08 

82 

109 

34 

67 

154 

1 09 

1 

72 

139 

35 

77 

148 

| 

1 
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Fig. 1. Diagram showing a correlation betwi 

grades obtained by a group of t 
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cance, limitations, and uses discussed. For the case of two variables 
nonlinearly related, we define and discuss the correlation index, p. The 
coefficient of multiple correlation is then defined for the case where the 
dependent variable is correlated linearly with two or more independent 
variables. Finally, we define the coefficient of partial correlation to 
describe the correlation (linear) between two variables when a third is 
held constant. 

2. The Correlation Coefficient, r. When variables X and F are cor¬ 
related rather than functionally related, we should no longer speak of 
a “best” F-value to correspond to each X-value but only of a most 
probable F-value about which observed values may be distributed 
according to some frequency distribution law. Obviously, the closer 
the observed values are to the most probable value, the more definite 
is the relationship between Y and X. This postulate is the basis for 
the various numerical measures of the degree of correlation. 

On the least-squares assumption that the observed set of data is the 
most probable set, the most probable F-value for a given X-value is 
that given by the least-squares equation. For the linearly related case 
with one variable only liable to error, the equation was derived in Chap¬ 
ter XI. With the origin moved to the point represented by the means 
XF, i.e., with change of variables to x = (X — X) and y = (F — F), 
the equation reduces, for the condition that the line must pass through 
the new origin (Eq. 35a of Chapter XI), to 



As a measure of the dispersion of the observed ^-values about the 
least-squares line, a quantity S v called the standard error of estimate 
is introduced. Defined by 




2(y - y c ) 


n 



it is the square root of the mean of squared deviations, not from an 
average but from values predicted by the least-squares line. 

The actual correlation coefficient, r, is defined by 

--V 1 w 

It is a numeric independent of the units of the variables correlated. 

As heretofore, the a of Eq. 3 denotes a standard deviation from a 
mean. But there is this difference: the mean as used here is merely an 
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average, while heretofore it has been additionally a best value for 
some measured quantity. The quantity, r 2 , is often called the 
coefficient of determination, and the quantity (S v /a y ) 2 , the coefficient 
of alienation. 

3. Limiting Values for r. Using Eq. 3, we can readily evaluate the 
limiting values which r may assume. Since (S y /<r y ) 2 cannot be negative, 
the maximum value of r is 1, corresponding to S y = 0; i.e., to 
2(y ~ y c ) 2 = 0. Thus, the maximum value of r occurs when all the 
observed points lie on the least-squares line (Fig. 2A). The minimum 
value of r is zero, corresponding to (£„/*„) 2 = 1, or S y = a y . For S y 



(A) (. B) (C) 

Fig. 2. Illustrating the distribution of observed points about the least-squares line 

for the extreme cases (A) r = +1; ( B ) r = 0; (C) r = — 1. 


to equal a y , it is necessary that y c = 0 and that the least-squares line 
shall be parallel to the X-axis and intersect the F-axis at F (Fig. 2 B). 
From Eq. 1 it is seen that y c = 0 when Zxy = 0, a relation which was 
recognized in the discussion of the propagation of precision indexes in 
Chapter IX as the condition for complete independence of variables 
x and y. Thus, the value r = 0 corresponds to complete lack of correla¬ 
tion. A negative correlation coefficient indicates that the assumed 
dependency is opposite to what has been supposed. It is, in effect, a 
positive coefficient for a reversed relation (Fig. 2C). 

4. Correlation and Frequency Distribution. Though not evident 
from the foregoing, it is possible to show that the correlation coefficient 
r is definitely connected with the normal frequency distribution of 
measurements. 1 Similar to the distribution law for measurements of a 
single quantity (Chap. VI), namely 

f(x) dx = h— e - h ' xi dx = — e -x2/2arJ dx M 

\A V2k(Tx 

1 Whittaker, E. T., and Robinson, G., The Calculus of Observations, London. 
Blackie & Son, Ltd., 1926. 
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it may be shown for the frequency distribution of pairs of measurements 
of separate quantities that 

f(x,y)dxdy 

_ _ 1 g — (1 2)|(**. »»*)—+ '■'*) [5J 

2™r I <r !/ Vl - r' 2 

In this latter expression, the r' represents an interdependence factor for 
the a: and y variables. If x and y are independent of each other, i.e., 
if r' equals 0, the sign of the xy term will be as often positive as negative 
and will disappear from the expression for probability of occurrence in 
the dx dy range. The expression then becomes 


[Rx,y) dx dy] r . =0 = —!— e~ «/2)[<*v^>+(*W" dx dy [6] 

27T (J x & y 


the well-recognized expression for the probability of simultaneous occur¬ 
rence of a randomly chosen pair of x- and y-values when those values 
are unrelated, or, as we often say, of two unrelated phenomena. If, on 
the other hand, the relation between .r and y is definite, i.e., if r* equals 
unity, we have 

[f(x,y) dxdy] r '=i = 0 [7] 


This likewise is the expected value for the probability of a simultaneous 
occurrence of an x- and a y-value chosen at random when the relation 
between x and y is definite. The interdependence factor r may be 
shown to be identical with the correlation coefficient r. 

5. Pearson’s Product Moment Formula. Eq. 3 is generally not the 
most convenient form for calculating the r for a particular set of data. 
To obtain such a form, we first replace y c of Eq. 2 by its equivalent as 
given in Eq. 1, obtaining 



Then, by the elimination of S u from Eq. 3, we have 



Zxy 

IKJjCy 





Eq. 9 is known as Pearson’s product moment formula. It is much more 
convenient than Eq. 3 for calculating r. 
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Going farther, we may use the short-method check equations for <j X) 
<T y , etc. (Chap. VII, Eq. 13), to express r in terms of the original vari¬ 
ables X and F. Then Eq. 9 becomes 


ZXY - nXY 

~ V(XX 2 - nX 2 ) (2 Y 2 - n¥ 2 ) 

= _ nLXY - 2 X2Y 

V[n2X 2 - (ZX) 2 ][nZY 2 - (2F) 2 ] 



Despite its formidable look, Eq. 10 is probably the most convenient 
form for calculating r. Especially is this true if a computing machine 
is available. Applying Eq. 10 to the 69 pairs of X- and F-values of 
Table I, we obtain 

2ZF = 884,280 [11] 

X = 75.7 [12] 

F = 165.3 [13] 

XX 2 = 406,727 [14] 

2F 2 = 1,985,220 [15] 

r = 0.62 [16] 


Since in Eq. 9 and therefore also fundamentally in Eq. 10 only devi¬ 
ations from the means of the quantities being correlated enter to deter¬ 
mine both the numerator and the denominator, the choice of zeros for 
the X and Y readings of Eq. 10 is arbitrary. To illustrate, in the corre¬ 
lating of the heights X of individuals with their weights F, it suffices 
in applying Eq. 10 to use only heights in excess of some conven¬ 
ient value, such as 5 ft 8 in., and weights in excess of some con¬ 
venient weight value, such as 160 lb. Further, since X and F appear 
raised to the same powers in both the numerator and the denominator 
of Eq. 10, the units in which X and 1" are expressed are also arbitrary. 
If for any reason computations are made more convenient thereby, in 
a problem like that just discussed, one might use the V\ in. as the unit 
of height and 2 lb as the unit of weight. Just how advantageous these 
considerations are will appear in connection with the next section. 

6. Correlation Coefficients for Grouped Data. When the number of 


pairs of items to be correlated is large, the calculation of r by the stand¬ 


ard procedure may be time-consuming. In such cases it is desirable to 
shorten the process by grouping the item pairs as is done in a correlation 
table. Table II illustrates how this mav be done for the mathematics- 

V 

physics grades of Table I. Note that for the mathematics grades 6 
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TABLE II 

An Illustration, Using the Data of Table I, of the Construction of a 
Correlation Table and the Computations Necessary for Obtaining r 


Pre-Mathematics Grades (X) 
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ranges have been selected with midpoints at 50, 60, • • • 100, and that 
for the physics grades 10 ranges have been selected with midpoints at 
80, 100, 120,- • • 260. In accord with the grouping principle, the pair 
of grades 57 for mathematics and 112 for physics is found in the cell, 
as it is called, which is at the intersection of the 55-65 column and the 
110-130 row. All of the pairs of grades that fall within the limits pre¬ 
scribed for this cell are to be treated in the computation that follows 
as though the mathematics and physics grades were respectively 60 and 
120. 1 able II shows that there arc 6 pairs of grades to be so treated. 

For the ranges chosen in Table II, there is a difficulty arising when, 
for instance, the mathematics grade is just 65. Different procedures 
are then possible. The grade may be recorded with half weight in both 
the 5o-65 and the 65-75 columns. Instead, it may be recorded with 
full weight in the 55-65 or lower column, with the understanding that, 
with the next similar occurrence, the grade will be recorded with full 
weight in the next higher column. Of course other rules may be set up 
in older that the effects of several such cases shall be negligible as to 
the combined results of the particular choices of assignment. 

As for the standard procedure described above, Eq. 10 is basic for 
the computations contained in a correlation table. Note that, taking 
advantage of the feature pointed out above, regarding the arbitrariness 
of the zeros and the units of measurement, the rather large and cumber¬ 
some numbers used in expressing X and Y in Table II have been replaced 
by the convenient small numbers of A'' and Y'. Values for A", Y', their 
frequencies/, ',/A' 2 , and/}'' 2 are shown in appropriately headed 

rows and columns. \ allies for fX'Y' } however, are to be found only in 
the lower right-hand corners of the cells. 

As might be expected, the grouped-data method with its approxima¬ 
tions yields for the data of Table I a result for r, namely 0.61, which is 
different from that obtained when the more precise method outlined 
above is used, namely 0.62. The difference, however, is quite insignifi¬ 
cant, as will appear in the later discussion of the physical significance 
of the r that was found. 

7. Physical Interpretation of a Correlation Coefficient. In general 
the value of the correlation coefficient provides the answer to the ques¬ 
tion: Io what extent is } dependent on X , judging from the particular 
tested sample from the infinite parent group of data? Two other ques¬ 
tions are usually of equal importance: (1) How is the value obtained 
for r to be interpreted? (2) To what extent does the r obtained for 
the sample apply to the parent group? Thus, for the sample of data 
contained in Table I. the value 0.62 was obtained for r. The question 
of the reliability of this value must await the discussion of the following 



PHYSICAL INTERPRETATION OF CORRELATION COEFFICIENT 279 

section. It is now desirable to consider the interpretation of 0.62 as a 
dependency indicator. There are two procedures. 

The first interpretation procedure involves giving attention to the 
corresponding S y /<r y > the quantity whose square has been referred to 
above as the coefficient of alienation. As indicated above, it is the 
ratio (Fig. 1) of the standard ^-deviation of the plotted points from the 



line representing the least-squares equation with y only liable to ciroi, 
to the standard deviation of the same points from the y-mean. The 
higher the correlation, i.e., the greater the dependency of y on x, the 
smaller is S y /a y . Rearrangement of Eq. 3 yields 

r* + g) 2 = 1 [17] 


whose locus on a plot, showing S„/a„ = f(r), is a circle (Fig. 3). 

The value of SJo y , corresponding to 0.02 for the value of r for the 
,ta of Table I, is 0.78. The value of <r„ for the same data, given by 


data 



v 


[18] 
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is 38.0. S u is 29.6. Correspondingly, Vy (= 0.675<r„) and P„ (= 0.675 S.) 
are 25.6 and 20.0. 

Referi ing to Fig. 1, note that lines A and B are drawn parallel to 

the X- and F-axes and indicate respectively the mean mathematics and 

the mean physics grades as shown by Eqs. 12 and 13. Lines C and D 
corresponding to 

F = F ± p y = 165.3 ± 25.6 [19] 

enclose between themselves one half of the plotted points. Line E is 

the locus of the least-squares equation computed according to Eq. 1. 
Its equation is 

Y = y c = 165.3 + L843(X - 75.7) [20] 

Lines F and G correspond to 


Y = Y c ± Py = 105.3 ± 20.0 + 1.843(X - 75.7) 


[ 21 ] 


Like lines C and D, lines F and G include between themselves one-half 

of the plotted points. The vertical separation of the latter two lines 

is less, however, than that of the first two, the ratio being that of S y /<r y 
or, what is the same, of P y /p y . 

We may now interpret the significance of an r of 0.02 or of an S y /a y 

of 0.78 as applied to the data of Table I. Given that a student has a 

giade of 00 in mathematics, what can we say of his probable performance 

in physics? Ignoring the correlation between mathematics and physics, 

our best estimate of his grade is 165.3 and the chance is 50% that the 

grade will lie between 139.7 and 190.0, i.c., in the range 165.3 =fc 25.6. 

Ho\\c\ oi, know ledge of the correlation between mathematics and physics 

giades, found from I able I, enables us to make a prediction in which 

we have considerably more confidence. From Fig. 1 we see that about 

190 is the most probable physics grade for the student whose math grade 

is 90, and further, the chance is 50% that his grade will lie between 176 

and 210, i.e., in the range 190 ± 20.0. The range for the predicted 

(n (hance, namely 2 P y) computed on the correlation basis is only 

O''8 of the corresponding range, namely 2 p y , that results in case corre¬ 
lation is ignored. 

In view of the foregoing one wonders why the ratio S y /a v was not 
chosen in place of r to represent correlation. One evident answer is 
that with increased correlation there is a decreased value for S y /<r y . 

In connection with the foregoing interpretation, no indication has 
been given of the reliability of the computed r, S y /a y> p y , and P y . These 
featuies will be discussed in the next section. 

A second interpretation of r treats it as a measure of common causes. 
If A is a linear function of i + k independent variables w’hich contribute 
equally to its values and T is a similar linear function of j + k inde- 
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pendent variables, where k is the number of variables common to both 
X and Yy it may be shown that 


k 

V(i + k)(j + k) 



On this basis, it would seem that a correlation of 62% for mathematics- 
physics grades would indicate that about 62% of the characteristics or 
activities required for the two subjects are common characteristics. 
While this interpretation can doubtless be tested quantitatively in some 
instances, just how it can be so tested in the case just mentioned is not 
apparent. Incidentally one would find it very difficult to so interpret 
a correlation coefficient of 0.95 relating the annual number of marriages 
in the Church of England and the standard mortality rate for the years 

1866 to 1911. 

It should be remembered that r is calculated on the assumptions that 
the values of Y and X are distributed normally and that, on the average, 
Y is directly (or inversely) proportional to X. Any significance which 
r may have decreases as the distribution of Y or X departs from nor¬ 
mality, and as the average relationship between Y and X becomes non¬ 
linear. With marked departures from normality or linearity, r loses all 
significance, and other measures of the degree of correlation should be 
used. 

8. The Reliability of Computed Correlation Coefficients. Question 2, 
asked at the beginning of the preceding section, is of interest heie. 
If r were a variable whose variations for a number of samples from the 
same parent universe were to follow the normal distribution law, the 
answer to the question would be simple. It would then be sufficient 
to calculate the precision indexes of r and interpret them in accord with 
the discussion of Chapters VI and VII. 

For small and moderate values of r the equation 


1 - r 2 


1 — T 


<Jr = 


_ - 

y/n — 1 \A 

where n is the number of X, Y pairs in the sample, seems to hold rather 
well. It fails, however, for small values of n and for values of / neai 
the limits of its range of distribution, i.e., near 1 or —1. In these 

regions the distribution of r is particularly skewed (Tig. 4). 

To simplify computation for such skew distributions, Fisher 1 intro¬ 
duced the function 

[24] 

1 - r 

’.search Workers, Chap. \ I, 7th Ed. 


1-4-?’ , 1 + r 

z = i In = 1.15 log- 


1 - r 

1 Fisher, R. A., Statistical Methods for Ii( 
Oliver & Boyd, Edinburgh, 1938. 
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Its distribution is nearly normal regardless of the true value of r (see 

Table V, Appendix 2) and is subject to certain normal distribution 
procedures. 

The standard deviation of z, a z , and its probable error, Vz , are found 
to be 


and 



p z = 0.G75 




where n is the numl)er of pairs of values used in 
hqs. 24 to 2(i, it is easy to calculate whether 


obtaining r or z. Using 
z, and hence also r, is 



I io. 4. Expectod distribution for computed values of r, obtained from samples of 

10 pairs of A,} values chosen at random from an infinite parent universe whose 
r is 0.80. 


significantly different from zero. Further, by the rule of propagation of 
precision indexes for related quantities, the standard deviation and the 
probable error of the difference of two values of z are 


and 


a (*2—*l) 


—*i) — a/cv , 2 -f- 


2 


a : - - 2ra s (f s 


P(z 2 —'i) ~ ^. 


[27] 

[28] 


P‘2 + P‘i 2 ~ 2 rp Zi p Zl 

It is accordingly relatively simple to calculate whether or not two values 
of z, and hence of r, are significantly different from each other. For 
translation to r, J able \ of Appendix 2 is again helpful. 
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Illustrating the foregoing, consider the 69-pair sample of Table I, for 
which a correlation coefficient of 0.62 was obtained. Using Eqs. 24 to 
26, we obtain in succession 


2 = 0.725 

[29] 

= 0.123 

[30] 

p z = 0.083 

[31] 


With the aid of the table showing r = f(z) referred to or by means of 
Eq. 24 directly, one finds that the limiting values of r corresponding to 
various assumed deviations in z involving a z and p z are those shown 
in Table II. Inspection shows that the limits of uncertainty of r with 


TABLE II 


Limiting Values of the Correlation Coefficient r, Computed as 0.62, and of 

Sy /< r v FOR THE DATA OF TABLE I TO CORRESPOND TO ASSUMED DEVIATIONS OF 

o>, 2a z , 2.5 &T Z , AND p 2 (Eqs. 25 AND 26) IN z (Computed AS 0.725, USING Eq. 24) 


Deviation in z 

Limits for z 

Limits for r 

Limits for S y /a y 

• 

Upper 

Lower 

Upper 

Lower 

Upper 

Lower 

o z 

0.123 

0.85 

0.60 

0.69 

0.54 

0.72 

0.84 

2 c r z 

0.246 

0.97 

0.48 

0.75 

0.45 

0.66 

0.90 

2.58<r z 

0.316 

1.04 

0.41 

0.78 

0.39 

0.62 

0.92 

• Pz 

0.083 

0.81 

0.64 

0.67 

0.56 

0.74 

0.82 


change in assumed uncertainty in z vary more for the lower limit of r 
than for the higher limit in the case of a positive value for r. From the 
standpoint of probable errors, it is found equally probable that, for 
other samples similar to that of Table I, the new succeeding values of 
r will lie as frequently without as within the range 0.56 < r < 0.67. 
For Sy/cry the range is 0.74 < S y /cr y < 0.82. From the standpoint of 
the many who attach importance to the 2.580-,. or 99% probability, it 
is very unlikely that any random sample from the parent universe of 
Table I will yield an r outside the range 0.39 < ?* < 0.^8 oi an S y /o u 

outside the range 0.62 < S u /<t„ < 0.92. 

Still referring to the math-physics grades of table I, we may next 
answer question 2 above, namely, “To what extent does the r obtained 
for the sample apply to the parent group?’’, by the following statements. 
If there were no correlation between math and physics giades, i.e., 
r = 0 for the parent group, the probability of obtaining the value 0.62 
or higher for r, or what is the same, 0.725 or higher for z (Eq. 29), in 
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a sample of 69 pairs of grades would be less than 0.0001. This is the 
probability of a deviation from the assumed zero value for 2 , whose value 
in terms of the observed <r, is at least 0.725/0.123, i.e., 5.9cr z . Hence, 
we may conclude that there is a decided correlation between the two 
grades. Further, on the basis of the 99% probability test for significance 
we may conclude that the value of r for the parent group from which 
the data of Table I are a sample lies between 0.39 and 0.78. 

9. Regression Lines. The least-squares line, Eq. 1, expressing the 
average relationship between Y and X, or between y and x, on the 
assumption that Y or y only is liable to error, is called the regression 
line of y on x. This name originated with Gal ton, who first applied 
the theory of correlation to biological data. Considering how a popu¬ 
lation could remain in dynamic equilibrium if the offspring inherited 
the characteristics of the parents, Galton found, in a study of the 
heights of fathers and sons, that the sons deviated from the mean height 
less than the fathers; i.e., the sons regressed towards the mean. Thus, 
he called the line relating the heights of sons and fathers the line of 
regression. 

Generally, two regression lines can be calculated for the case of two 
correlated variables; (1) the regression line of y on x —the least-squares 
line obtained on the assumption that x-values are exact, and (2) the 
regression line of x on y —the least-squares line obtained on the assump¬ 
tion that y-values are exact (Fig. 5). The equation of the regression 
line of y on x as given above is 



By analogy, the least-squares line obtained on the assumption that 
//-values arc exact is 



or, when expressed in the more common form 



From Eq. 9, it follows that 





[33] 

[34] 


Thus, the correlation coefficient between y and x is the square root of 
the ratio of the slopes of the two regression lines. 
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It is seen that r has the same value regardless of whether x or y is 
taken as the independent variable. None of the other coefficients to 
be discussed possesses this desirable property. Referring to Galton’s 



III W -- 

Fig. 5. A graphical method for computing correlation coefficients applied to the 
data of Table I and Fig. 1. The X-intervals are 10 units in length, with centers at 
mathematics grades 45, 55, 65, etc. The F-intervals are 20 units long with centers 
at 70, 90, 110, etc. The lines of regression A^_ of Y on X, and B, of X on Y, were 
drawn with due regard to the central point (X, Y) and to the weights attached to 

each plotted point. _ 
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conclusion that the heights of sons regressed toward the mean, one 
must conclude that, if the best relation between the heights of fathers 
and sons Is linear, the heights of fathers likewise icgiess Iowan t a m< an. 
10. A Graphical Method for Computing Correlation Coefficients. 
1. 34 is the basis for an approximate graphical method for evaluating 


Eq 


oi to Liiv" uiwio . * 7 ,. 

r. This method consists in (1) plotting the data (1-ig. :>); (2) dividing 
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the X- and 7-axes into a convenient number of equal class intervals; 

(3) replacing the points in each ^-interval by a weighted mean point 

(the O’s of Fig. 5) and fitting the best straight line—the regression line 

of y on x to these points; (4) replacing the points in each 7-interval 

by a weighted mean point (the X’s of Fig. 5) and fitting the best straight 

line—the regression line of .r on y —to these points; (5) computing the 

slopes of the two lines and substituting into Eq. 34 to obtain the de- 
sired r. 

Foi many purposes the results obtained by this more rapid approxi¬ 
mate method are sufficiently accurate. The data of Table I, when 
treated graphically as in Fig. 5, yielded 0.02 for r. This exact check 
with the value (Fq. 10) computed by the direct application of Eq. 10 
is fortuitous. C omputed values ranging from 0.59 to 0.65 would have 
been considered equally satisfactory as checks. 

11. Nonlinear Correlation. AY hen the relationship between two cor¬ 


related variables is decidedly nonlinear (Fig. 0), the correlation coeffi- 



Weight of Tin Coating in Pounds per Base Box 

Fig. 0. An example of nonlinear correlation—hydrogen evolution test values plotted 
as a function of tin coating weights for hot dipped tin plate. Note that if the 
hydrogen evolution test value is taken as independent, the resultant regression 
curve would have a greater curvature than has the plotted curve. (Courtesy oj 
Mr. G. C. Jcnison.) 
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cient r loses its significance and indicates a lower degree of correlation 
than actually exists. In such cases the index of correlation, p, is con¬ 
sidered by some to be more reliable. It is defined by the equation 





The quantities represented by S v and a v are analogous to those of Eq. 3 
defining r; the only difference is that now S y 2 is the mean of the squares 
of deviations of observed points from a least-squares curve (the regres¬ 
sion curve) rather than from a least-squares line. The index of corre¬ 
lation differs from the correlation coefficient in two important respects. 
The first difference lies in the fact that for a given set of x and y values 
there is only a single value for r, but many values for p, a different value 
for each type of equation that may be used to represent the relation 
between y and x. Thus, a value of p has little or no meaning unless 
the form of the least-squares equation fitted to the data is also reported. 
The second difference between p and r arises from the fact that the value 


of r for a set of x- and y-v allies does not depend on which variable is 
assumed dependent and which independent, while the reverse is true 
for p. Consequently, it is customary to add a subscript to p, e.g., p y , 
to indicate which variable is assumed dependent or subject to error. 

Considering the uncertainties connected with the interpretation of 
any measure of correlation, it is doubtful that much is gained by calcu¬ 
lating p instead of r unless the curvature of the regression curve is very 
marked. 

12. Multiple Correlation. We may sometimes consider a variable Ai 
to be dependent on two or more independent variables, X 2 , XV • *, and 
desire to know the correlation between X\ and X 2 , .XV •• For this 
purpose, a coefficient of multiple correlation may be calculated. It is 
usually sufficient to consider X\ a linear function of X 2 , A 3 * • • I hen 


the coefficient of multiple correlation between A 1 , and A 2 , A 3 • • •, usually 
designated by the symbol 7 ?, .23..., is the same as the simple coefficient 
of correlation between observed values of A 1 and corresponding values 


obtained from the least-squares equation 


Xic = a -f bXz 4- cX :i H- 


[30] 


for which the independent variables are Xo, A3, etc. It is seen from 
Fig. 7 that for two independent variables, the coefficient- of multiple 
correlation is analogous to r and to p except that the value of S v m is 
now determined by the deviations of observed points from a least-squares 
plane rather than from a least-squares line or curve. 
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Fig. 7 . Illustrating multiple correlation for the case where Xi is viewed as dependent 
on Xo and X3. The short straight lines attached to the plotted observed points 
represent, on the assumption that X\ only is liable to error, deviations of the ob¬ 
served Xi from the plane of regression of Xi on A2A3. 


13. Partial Correlation. The simple correlation coefficient between 
variables A"! and X 2 indicates from one point of view, expressed above, 
the percentage of factors common in the determination of Xi and X 2 - 
If one such factor is the value of a third variable, AT 3 , it is sometimes 
desirable to determine the coefficient of partial correlation between X\ 
and X 2 ; i.e., the coefficient of correlation between the values of X t and 
X 2 after the effects of A' 3 on each has been deducted. Given a set of 
corresponding values of A”i, X 2 , and A” 3 , the coefficient of partial corre¬ 
lation between A"i and X 2 with the effect of X 3 removed—symbolized 
by ?'i 2 . 3 —is obtained by calculating first the least-squares line relating 

Xi and A r 3 

X\ c = a 1 + b l3 X 3 [37] 

then the least-squares line relating X 2 and X 3 

X 2c = 02"!- b 23 X 3 ^ [38] 

and finally the simple correlation coefficient between the differences 

(A r i - X u ) and {X 2 - X 2c ). 

The effect of any number of other variables—A' 3 , X 4 , X 5 , etc.— may 
be simultaneously removed from the values of A^ and A’ 2 in a similar 
manner and the partial correlation coefficient r, 2 . 34 5 ... obtained. 
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Calculations are usually simplified by use of the determinant R de 
fined by 

1 r 12 ri3 • • • Tik 

r 2 1 1 7*23 • • • r 2 k 








rki r k 2 r k 3 * * • 1 


where r 12 (= r 2 i) is the simple correlation coefficient between X\ and 


X 2f etc. It may be shown that 

r 12.34 ...* 


R\2 

V R\\R22 



where R\ 2 represents the cofactor or the minor of ri 2 in the determinant 
R , etc. 

14. S umm ary. Where y is a function of x and of other unknown 
variables, it is sometimes desirable to express the dependency of y on 
x to the extent possible. For this purpose the correlation coefficient, 
r, has been developed for cases where the relation is assumed lineai and 
the index of correlation, p, for cases where the relation is nonlinear. 
The correlation coefficient is defined by 



where <j y is the standard deviation for the given distribution of values 
for the dependent variable and S y , called the standard error of estimate, 
is a similar standard deviation for deviations from the least-squares line 
with the dependent variable y only liable to error, which best represents 
the plotted data. With the origin of coordinates shifted to the means 
of the X’s and the F’s, the least-squares equation for the best line is 



and the expression for S y is given by 



[ 1 ] 

[ 2 ] 


The limiting values for r are 0 and ±1. A negative 
cient is in effect a positive coefficient lor a supposed 


correlation coeffi- 
rcversed relation, 
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Correlation coefficients may be shown to be connected with frequency 
distributions. 

The most convenient formulas for computing r are 



Xxy 
r = - 

Yl(J jr(T y 



_ nXXY - 'ZX'ZY _ 

~~ y/[nZX 2 - (SX) 2 ][n2r 2 - (2F) 2 ] 



of which x and y differ from X and Y only in that the values for x and y 
are measured from the moans of X and Y as origin while X and Y are 
measured from the physical origin associated with their actual measure¬ 
ments. 

There arc two ways of interpreting a correlation coefficient. The 
first consists in determining first the ratio S y /a y and then noting that, 
by means of it, predicted values for Y to correspond to given values of 
X obtained with correlation procedure will deviate on the average from 
actual occurring values less than when correlation factors are ignored. 
The fractional amount less is precisely the ratio S y /a y . The second 
method of interpreting r relates it to a function of the common factors, 
k, and noncommon factors, ? and j, determining the magnitudes of the 
two variables being correlated. Thus 


r = 


V(i + k) (j + k) 


[ 22 ] 


Because the distribution of /-values is skewed, even when the distri¬ 
butions of the variables correlated are normal, procedures for deter¬ 
mining precision indexes of an individual correlation coefficient are dif¬ 
ferent from the normal procedure. 

In the text the foregoing has been applied in some detail to the corre¬ 
lation of physics and mathematics grades obtained by a group of 09 
students. 

Two regression lines are distinguished. One is that of y on x. It is 
the least-squares line 

[ 1 ] 


2-ryl 

yc = x = bx 

ZjX _ 


The other is that of x on y. It is the least-squares line 



[33] 
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Combined with Eq. 9, these equations lead to 

r = = A ro 41 

V 2.r 2 2 y 2 V V [3] 

Eq. 34 shows that, when linear correlation between two variables is 
sought, it is immaterial which variable is assumed to be the independent 
variable. Further, Eq. 34 serves as the basis for an abbreviated graph¬ 
ical method of determining correlation coefficients which is described 
fully in the text. 

An index of correlation p defined by 

p = yji-H [35] 

a V 

has been developed for nonlinear cases. Here S y 2 refers to deviations 
from a least-squares curve rather than from a straight line. In specify¬ 
ing values for p, the type of least-squares equation assumed and the 
variable assumed dependent must be stated. 

Multiple correlation coefficients have been developed for cases where 
the dependent variable is viewed as a function of several independent 
variables. 

Partial correlation coefficients have been developed for two variables 
for cases where the effects of other related variables have been eliminated. 


PROBLEMS 


1 . The proper motion of a star is its apparent, angular velocity about the sun as 
seen against the background of the celestial sphere. It is ordinarily expressed in 
seconds of arc per year. The parallax of a star is one-half the angle which the earth s 
orbit subtends at the star. It is ordinarily measured in seconds of arc. The greater 
a star’s distance the less is its parallax. A certain correlation is to be expected 
between these two commonly measured quantities. For certain reasons it is much 
more convenient to find such a correlation for the logarithms of the proper motions 
and the parallaxes rather than for the quantities directly. I'sing the \alues or P r ‘ ) P^ 1 
motion and parallax given by Russell, Dugan, and Stewart {Astronomy, \ ol 2 , p. 037 , 
Ginn & Company, 1027 ) for the 22 brightest stars, determine the correlation co¬ 
efficient connecting the logarithms of those quantities. State in words the physical 
interpretation you are able to give to your computed value. 


Star 

a Canis Majoris (Sirius) 
a Carinae 
a Centauri 
a Lyrae (Vega) 
a Aurigae (Capella) 


Proper Motion 

Parallax 

(seconds year) 

(seconds) 

1.315 

0.37! 

0.022 

. 005 

3.»jK2 

. 758 

0.3 IS 

. 124 

0.-130 

.009 
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Proper Motion 

Parallax 


Star 

(scconds/year) 

(seconds) 

a 

Bootis (Arcturus) 

2.287 

0.080 

0 

Orionis (Rigel) 

0.005 

.006 

a 

Canis Minoris (Procyon) 

1.242 

.312 

a 

Eridani (Achenar) 

0.093 

.049 

p 

Centauri 

0.039 

.011 

a 

Aquilae (Alt-air) 

0.659 

.204 

a 

Orionis (Bctelgeuse) 

0.032 

.017 

a 

Crucis 

0.048 

.014 

a 

Tauri (Aldebaran) 

0.205 

.057 

P 

Geminorum (Pollux) 

0.623 

.101 

a 

Virginis (Spica) 

0.051 

.014 

a 

Scorpii (Antares) 

0.032 

.009 

a 

Pisces Australis (Fomalhaut) 0.367 

.137 

a 

Cygni (Deneb) 

0.004 

.005 

a 

Leonis (Regulus) 

0.244 

.058 

P 

Crucis 

0.054 

.016 

a 

Geminorum (Castor) 

0.201 

.076 


2. In a particular application, it was decider! that a saving in time and cost would 
result if the chemical analysis for copper in steel with a copper content ranging from 
0.02% to 0.20%, could be replaced by a spectrographic method. As a criterion of 
application, it was arbitrarily decided that the spectrographic and the chemical 
analyses should agree to within 0.01% of copper, 99% of the time. In a test using 
52 samples, the following values in % for copper content were obtained. 


Chemical 

Spectrographic 

Chemical 

Spectrographic 

Chemical 

0.092 

0.104 


0.097 


.128 

.127 

. 067 

.087 


.080 

.083 

HI 

.068 

.088 

.086 

.087 

.066 

.054 

. 126 

.080 

.078 

.103 

.106 

.076 

.118 

.107 

.054 

.062 

.044 

.086 

.102 

.082 

.072 

.060 

.105 

.108 

.096 

.101 

.110 

.096 

.110 

.128 

.140 

.100 

.084 

.100 

.163 

.172 


.102 

' .090 

.084 

.073 


.100 

.101 

.192 

.188 


.122 

.129 

.150 

.151 


.126 

.135 

.148 

.148 

.152 

.102 

.099 

.089 

.093 

.142 

.108 

.104 

.144 

.136 

.090 

106 

.107 

.114 

.115 

.106 

108 

.103 





'Spectrographic 

0.113 
.096 
.082 
.114 
.074 
.046 
.064 
.110 
.095 
.096 
.122 
.073 
. 220 
.164 
.130 
.096 
.103 
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Determine the correlation coefficient, its probable error, and, on the basis of a normal 
distribution of measurements and of differences, the correlation coefficient that is 
demanded in order that the arbitrary criterion should have been satisfied. 

3. Given the data below showing metabolism rates, M, taken in a more or less 
haphazard order, for guinea pigs as a function of the temperature of the surrounding 
atmosphere, T, as reported by Herrington 1 of the John B. Pierce Laboratory of 
Hygiene at New Haven, Conn., determine the correlation coefficient, using Pearson’s 
product-moment formula. 


T 

in °C 

M in 
kcal 

T 

in °C 

M in 
kcal 

T 

in °C 

Min 

kcal 

m 2 day 

tn 2 day 

m 2 day 

35.3 

716 

27.9 

720 

21.1 

894 

34.7 

557 

27.8 

678 

21.0 

815 

34.7 

600 

27.8 

677 

20.9 

898 

34.6 

885 

27.8 

739 

20.7 

812 

34.6 

719 

27.7 

777 

20.3 

839 

34.3 

694 

27.6 

700 

20.2 

988 

33.6 

620 

27.2 

693 

20.0 

913 

32.8 

701 

26.8 

753 

19.7 

968 

32.5 

673 

26.7 

713 

18.1 

991 

32.2 

579 

26.3 

766 

17.6 

1005 

32.0 

687 

26.1 

725 

17.5 

935 

31.9 

676 

25.7 

893 

16.7 

917 

31.4 

638 

25.4 

752 

16.7 

999 

31.2 

644 

25.3 

801 

16.4 

971 

31.2 

594 

24.8 

784 

16.4 

959 

30.9 

607 ' 

24.2 

789 

16.4 

983 

30.9 

621 

23.7 

787 

16.4 

993 

30.7 

586 

23.2 

794 

16.3 

1023 

30.3 

561 

23.1 

891 

15.8 

1071 

30.3 

592 

23.1 

797 

15.4 

1065 

29.8 

601 

23.1 

835 

15.1 

1050 

29.6 

703 

23.0 

855 

14.0 

1057 

29.4 

583 

22.7 

799 | 

1 13.6 

1057 

29.4 

672 

22.7 

905 

j 

13.5 

| 

1 101 

29.3 

628 

22.6 

804 

13.5 

1 1 iU 

29.1 

601 

22.6 

833 i 

13 3 

1085 

28.8 

670 

22.5 

810 

13.3 

1017 

28.8 

605 

22. -1 

742 

: i3.i 

1071 

28.5 

756 

22.2 

I 852 J 


i 

28.2 

631 

21 .6 

s77 


l 


> Determine the equations of the hoes of „ a„--inn an,I tin- e.„-n lati-n —Hn 
cients for the data of problem 3, using th«- tfraphir-al iim-iIm»*1. 


1 Herrington, I.. P., Am. J. Phyaiology, 129 , •I'.Mu 













CHAPTER XIII 


HARMONIC 


1. Introduction. A periodic function, as used here, is one which is 
composed in part or in its entirety of a Quantity whose magnitude varies 
in a regular recurring manner. In some cases the periodic variation is 
sinusoidal, as for the emf of a dynamo. In other cases the variation is 
in accord with some other law, as that for the magnitude of an eclipsing 
binaiy. Some functions contain hut one periodicity and are simple. 
An illustration is the displacement of a particle in simple harmonic 
motion from its position of equilibrium. No further comment regarding 
such functions is needed here. Other functions contain more than one 
periodicity and are complex. Those belonging to this latter group are 
fuither subdivided into two types, the harmonic and the non-harmonic. 

An illustration of the complex harmonic periodic function is that de¬ 
scribing the motion of a particle of a bowed violin string. Such func¬ 
tions may be represented by Fourier series and are subject to Fourier 
analysis (C hap. \ ). 1 he frequencies involved are a fundamental and 

harmonics with frequencies which are whole-number multiples of that 
fundamental. Illustrations of the non-harmonic periodic function (the 
descriptive term “complex” is not needed here because there are no 
simple non-harmonic periodic functions) are (1) the height of a tide at 
a given place as a function of time, (2) the forced vibrations of a struc¬ 
tural member, (3) the frequency of occurrence of sunspots, (4) the solar 
constant, and (5) the magnitude* of a doubly or trebly eclipsing multi¬ 
component star. The analysis of functions of this type forms the sul>- 
ject matter of this chapter. Actually the theory applies as well to 
complex harmonic periodic functions. In fact, where the harmonics 
are of rather high orders, i.e., have* frequencies many times those of the 
fundamental and where the range given in the data for the independent 
variable is less than that needed for the complete representation of an 
assumed fundamental, the Fourier series method may fail, leaving meth¬ 
ods like that advanced here as perhaps the only one possible for an 
analysis. 

Normally there are two parts to the analysis of a non-harmonic 
periodic function, (1) the search for the periodicities and (2) the deter¬ 
mination of their magnitudes. In some cases, e.g., the tides, the perio- 
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dicities, at least most of them, are known with some precision in advance 
because of the known causes. The same is true sometimes with regard 
to structural vibrations. For these cases, the first step of the normal 
procedure is greatly shortened. For the other cases, foi \\ nc 1 e 
normal procedure is generally rather long drawn out, inspection pioc 

esses will often help in reducing the time required. 

Since the procedure for a case involving three or more unknown 

periodicities is the same as for the case involving on y two an 
from it essentially only in being longer, a case in\ ol\ ing 6n y \\o c p™ 
ponent periodicities has been selected for discussion. 1 oieo\ei, .'i 
nothing in generality is lost and something in completeness is ga mt 
using a function composed of sinusoidal components, t u unc ^ 
been thus further restricted. In what follows, we rs c iscuss , 
lying theory, make a search for the periodicities, an u n in 

mine their amplitudes. 

2. General Theory. Let 


* = f { t) = a + a' sin ( + &') + «" «« (p 1 + *") + 


= a + 2' + 2 " + 


[ 1 ] 


, , , „ .. ore triven corresponding 

describe a function for which values, z u *2, s, 4 . atcd from one 

to various successive instants of time, b, 2, 3 ’ function chosen is not 

another by the constant mtcrva , r. 1 unchanged up 

sinusoidal, the treatment that foUows , attention is transferred 
to a certain point. That point is reachec , i 

from periods, for example, to amplitudes an P annarent bv 

Let the fluctuations in * and the data be .such that .t . >J^rent y 

inspection that one of the periods 1 ™witive unknown 

, , f w»nrosentlli£ a positive 

where m is a whole number. With € l 
fraction less than unity, we may write 

T' = (/«' + € ') r ^ 

Alsolet , „ , „X T [3] 

T" = (m + « ) T 

, i moininir but both unknown, 

of which m" and similar to m and e n(i 1)( .| iodieity is concerned. 

represent the condition so far as the s<*< o If the fluctuations 

For the present, let m' and ia" be ^ ^ ^ 

are such that a value for m' or m i«’ " (li | !( ,’ ( . n< . e> as will appear 

procedure will remain unchanged, i 

later, is in the amount of labor involvw ■ defined 

With the data tabulated and an approximate \ aluc 


f 
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by Eq. 2 or Eq. 3, obtained by inspection or otherwise, the next step 
in the search for the periodicities consists in arranging the given values 
of z and certain of their means in the following array 


Z\ 

22 

2.3 

z m’+1 

z m ’ +2 

Z m '+3 

z 2rn'+l 

• 

• 

z 2m’+2 

• 

• 

z 2rn'+3 

• 

• 

• 

z km’ + \ 

• 

z km'+2 

• 

Z km'+3 

Z’ 1 

Z'o 

Z's 


Zm' 


• • • 22 


m 


• * z 3m / 


[A] 


2 a- + l)m' 

• • • — 

V' 

& in' 

Let Z i, /j 2 , 7j 3 , • • • represent the means for the successive columns. 

Next one determines <r„ the standard deviation for the entire group of 

2 values of the array; <r z >, that for the means Z\ • • -Z' m q and the ratio 

gz'/gz' 1 he \ aluc* of <r z does not depend on the details of arrangement 
in an array. 

If (k -f- the number of periods of magnitude T" involved is 

\ei\ huge, the condition that 1' and T" differ appreciably and arc 
incommensurable will insure that the contributions of the 2 "-term of 
Eq. 1 to the various Z s will be approximately equal. All of the varia¬ 
tions in the means will then be due to the 2 '-term, and the <r z > that has 
been computed will be a function solely of that term of Eq. 1 and the 
array A. 

Consider now the effect on a <r z , due to a variation of e. For the 
discussion that immediately follows, assume that we have at hand the 
values of the function of 2 of Eq. 1 at all instants desired rather than 
at instants differing only by r. We may therefore consider arrays like 
that of A above with varying r’s and consequently varying e’s. Consider 
the case of e = 0. It is now evident that, if for one 2 in a particular 
column the 7-periodicity has given its maximum contribution, every 
other 2 in the same column will have received necessarily the same maxi¬ 
mum contribution. The evident result is that the a z for that con¬ 
dition will be a maximum. For any slight shift of r yielding an e other 
than zero, the <j z then computed will be smaller. Only when a a z is 
known to be a maximum can we be sure that the corresponding tnr 
represents a true period for the function. 

Generally data are not available for testing with the gradually varying 
r assumed possible just above. We must seek the condition for a maxi¬ 
mum a z from values for various instants corresponding to a fixed r. 
In practice this condition of varying r is approximated by an artifice. 
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Occasional appropriate values for z are omitted from the original set, 
their places in the array are filled by the items of the original set next 
in order, and the series of values thus obtained are treated in the regular 
manner but with the understanding that now the period is equal to 
(m + e)r. How this can be done will be illustrated later. It is sufficient 
to say here that one may thereby effectively determine various a z s 
corresponding to various e’s, to find the e which yields the desired maxi¬ 
mum for <r z . Strictly, the maximum < t z /<t 2 , sometimes called the corre¬ 
lation ratio, is desired, for <j z will vary slightly with the omissions. In 

practice, a maximum for a z often suffices. 

For sinusoidal periodicities only, the values of (a z >/a z ) f (oW^), and 
other similar ratios that may have been obtained for other periodicities 
present may ordinarily be used to determine the relative amplitudes of 
these various components and to determine at any stage in the pro¬ 
cedure whether any remaining periodicity has been left undiscovered. 
To show this, one needs to consider in detail how the various a s and the 

amplitudes are related. 

For the assumed case of incommensurable periods and a sufficiently 
great number of measurements, we have largely as a result of definitions 
the following relations for the case of an array of n terms: 



(<rz ") 2 



and 

at = - S( Z - a ) 2 

n 



-S {z' + z" +■■■? 
n 


= ' S(z' 2 + 2z'z" + z" 2 + • ••) [6] 

11 


In the above expression, the summation for the term 2z z will yield 
zero, since for the signs of the terms being summed the result will be 
as often negative as positive. Eq. (>, with the aid of Eqs. 4 and 5, may 
therefore be reduced to 


2 _ 


- 2 (z rz + *" 2 + 
n 


) = <r Z ' 2 4“ QZ' 2 “b 


• • 
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From Eqs. 4, 5, and 7, we obtain finally 




o!_ _ a z 

d" (s z" 




[8] 

[9] 


Fq. 8 shows that the amplitudes of the various components of z vary 
as their <jy/a z s. Eq. 9 shows that the sum of the squares of the various 
°zhz s must add up to unity. If, then, at any time in an analysis 
the sum of the values obtained for (ay/a z ) 2 equals unity, one may be 
certain that the period analysis is over. Strictly speaking, owing to 
the approximations involved in the artifice employed and those occur¬ 
ring in Eqs. 4 and 5, one may expect Eqs. 8 and 9 to be only approxi¬ 
mately fulfilled. W hat the expected relations are for certain other types 
of periodicities is the subject of a problem at the end of the chapter. 

An approximate amplitude a may be obtained more directly. From 
the Z’s of an array that yields a maximum (jy/<j z one may take for its 
value one-half the difference between the greatest and the smallest 
values algebraically considered. However, the value thus obtained will 
be exact only if the chosen Z’s correspond to a maximum and a minimum 
for some particular component of the 2 of Eq. 1, if the number of items 
is sufficient to insure that the contributions of the other components to 
the various Z’s are strictly equal, and if the corresponding T is just 
equal to an ?nr. Within its limitations, this method of obtaining an 
amplitude has considerable value. 

3. Application of Theory to Determinations of Periods. Data for a 
function possessing two sinusoidal periodicities such as the 2 of Eq. 1 
are given in Table I and graphed in Fig. 1. Let us apply the theory 
of the preceding section to this data to obtain values for V and T" and 
then later to evaluate a' and a". 

Inspection of Table I shows positive maxima occurring at roughly 
regular intervals. In terms of r, the intervals in succession are 9, 7, 
9, 7, 9, 9, 7, 9, 7, and 9. One of the periods, T' say, would seem to be 
about equal to 8 sec. Let us make this assumption and construct 
Table II in accord with array A. (In what follows the reading z = 0 for 
t = 0 sec has been inadvertently omitted. That such is the case is of 
no material importance, however.) Should it have been difficult or 
impossible to obtain an approximate value for T by inspection, it would 
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be necessary to assume various values for T' and to determine in an 
exploring way, using perhaps a part only of the data and the method 
that follows, regions where the periodicities are actually located. Simple 

inspection has eliminated such exploration. 

Computations, made in accord with the preceding section, when ap¬ 
plied to the array of Table II, yield the values shown for z, Z , <r //. a z , 
and the ratio az’la z . In determining the <r’s, it is well to use the short 
method of Chapter VII, Eq. 13, namely 



Inspection of Table II shows that maxima tend to shift from columns 2 
and 3 to columns 3 and 4 as we progress through the table. It would 



seem probable that if the effective value for V were made equal to 8.1 
sec or 8.2 sec, the greatest possible range for the values of Z might be 
obtained and possibly the greatest possible values for <r z - and for a x ./a z 
With the above in mind, let us construct Table III on the assumed 
basis that V - 8.20 sec. In so doing it is necessary to include the range 
ofJ2 readings rather than 80, as was done in Table II. Two readings 
oflie 82 must be eliminated. The basis for selecting the readings to 
be dropped follows. Starting with the assumption that the first, reading 
is exactly in phase for an assumed cycle covering 8.20 see, oni s<cs t lat 
the phases of the next several readings lead progressively with respect 
to the readings that would be used were they available for regular 
intervals 1.02 sec (= % X 8.20 sec) long. Nevertheless the readings 
available are used in succession until it happens that by omission of 
some one reading the phase difference, thereafter for a time a phase lag, 
is reduced. Some reflection will show that, where there are n positions 
in the array and that r numbers from a total of n + r numbers are to 
be dropped on the basis of a minimum for the sum of the phase differ- 
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ences, the positions of drop in the sequence of n + r numbers are given 
by the fractions n/2r + 1, 3n/2r + 2, 5n/2r + 3, etc. Thus for an 
array of 80 with two numbers to be dropped out of a sequence of 82 


TABLE I 


Values, Uniformly Spaced in Time, for a Non-harmonic Function 
of the Type Shown in Eq. 1, and Their Squares 


[The * indicates maximum values. 


The arbitrary time interval, r, elapsing between successive readings 
is 1.00 sec] 


t 

(sec) 

z 

0 

0 

1 

+ 116 

2 

+ 133* 

3 

+ 52 

4 

- 43 

5 

- 77 

0 

- 59 

7 

- 37 

8 

- 24 

9 

+ 9 

10 

+ 74 

11 

+ 114* 

12 

+ 08 

13 

- 50 

14 

-143 

15 

-122 

1G 

- 7 

17 

+ 97 

18 

+ 110* 

19 

+ 51 

20 

- 9 

21 

- 33 

22 

- 44 

23 

- 00 

24 

- 70 

25 

- 14 

20 

+ 85 

27 

+ 140* 

28 

+ 84 



O 

2“ 

t 

(see) 

z 

2 2 

t 

(sec) 

z 

z 2 

0 

29 

- 46 

2,116 

58 

+ 86 

7,396 

13,456 

30 

- 87 

7,569 

59 

+ 144* 

20,736 

17,089 

31 

-115 

13,225 

00 

+ 80 

7,396 

2,704 

32 

- 10 

256 

61 

- 19 

361 

1,849 

33 

+ 05 

4,225 

62 

- 80 

6,400 

5,929 

34 

+ 78* 

6,084 

63 

- 72 

5,184 

3,481 

35 

+ 50 

2,500 

64 

- 40 

1,600 

1,309 

30 

+ 29 

841 

05 

- 21 

441 

570 

37 

- 4 

10 

66 

0 

0 

81 

38 

- 30 

900 

07 

+ 51 

2,001 

5,470 

39 

- 87 

7,509 

08 

+ 104* 

10,816 

12,990 

40 

-108 

11,004 

09 

+ 90 

8,100 

4,024 

41 

- 32 

1,024 

70 

- 9 

81 

2,500 

42 

+ 90 

8,100 

71 

-121 

14,641 

20,449 

43 

+ 150* 

22,500 

72 

-143 

20,449 

14,884 

44 

+ 90 

8,100 

73 

- 50 

2,500 

49 

45 

- 35 

1,225 

74 

+ 73 

5,329 

9,409 

40 

-115 

13,225 

75 

+ 122* 

14,884 

12,100 

47 

- 97 

9,409 

76 

+ 77 

5,929 

2,001 

48 

- 27 

729 

77 

+ 3 

9 

81 

49 

+ 24 

570 

78 

- 30 

1,296 

1,089 

50 

+ 39 

1,521 

79 

- 44 

1,936 

1,930 

51 

+ 50 

2,500 

80 

- 55 

3,025 

4,350 

52 

+ 08* 

4,624 

81 

- 07 

4,489 

4,900 

53 

+ 50 

3,130 

82 

- 35 

1,225 

190 

54 

- 18 

324 

83 

+ 52 

2,704 

7,225 

55 

-112 

12,544 

84 

+ 129* 

16,641 

19,000 

56 

-128 

16,384 

85 

+ 113 

12,769 

7,050 

57 

- 44 

1,936 

80 

- 2 

4 


numbers, the numbers to be dropped are the 21st and 62nd. Table III 
shows the data of Table I arranged thus on the assumption that V = 
8.20 sec. One sees at once from the positions of the maxima and from 
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the correspondingly increased value for <T Z ’/<r z that this second guess 
regarding T' is much better than the first. 

Results from treatment similar to the above for additional assumed 
values for T' of 8.10, 8.30, and 8.50 sec added to those shown in Tables 

TABLE II 

The Data of Table I Arranged Similar to Array A on the Assumption that 

T = 8.00 Sec 

[The numbers at the bottoms of the columns are the mean Z”s. As in Table I, * indicates a positive 



maximum. The value for t 

= 0 sec has been inadvertently omitted] 

+ 116 

+ 133* 

+ 52 - 43 

— 

77 

- 59 

- 37 

- 24 


+ 9 

+ 74 

+ 114* + 68 

— 

50 

-143 

-122 

- 7 


+ 97 

+ 110* 

+ 51 - 9 

— 

33 

- 44 

- 66 

- 70 

z = Z'= +2.1 

- 14 

+ 85 

+ 140* + 84 

— 

46 

- 87 

-115 

- 16 

<JZ' — 64.4 

+ 65 

+ 78* 

+ 50 +29 

— 

4 

- 30 

- 87 

-108 

- 32 

+ 90 

+ 150* + 90 

— 

35 

-115 

- 97 

- 27 

o z = 77.8 

+ 24 

4 

+ 39 

+50 + 68 * 

+ 

56 

- 18 

-112 

-128 

- 44 

- 21 

+ 86 

0 

+ 144* + 86 
+ 51 +104* 

+ 

19 

90 

- 80 

- 9 

- 72 
-121 

- 40 
-143 

07 ' 

— = 0.828 
<*z 

- 50 

+ 73 

+ 122* + 77 

+ 

3 

- 36 

- 44 

- 55 


+ 15.0 

+76.8 

+92.4 +55.4 


11.5 

-62.1 

-87.3 

-61.8 



TABLE III 

The Data of Table I Arranged Similar to Array A on the Assumption that 

T' = 8.20 Sec 


[The numbers at the bottoms of the columns are the mean Z"s. As in Tables I and II, * indicates a 

positive maximum] 


+ 116 

+ 133* 

+ 52 

-43 

- 77 

- 59 

- 37 

-24 


+ 9 

+ 74 

+ 114* 

+68 

- 50 

-143 

-122 

- 7 


+ 97 

+ 110* 

+ 51 

- 9 

- 33 

- 66 

- 70 

-14 

z = Z'= + 

+ 85 

+ 140* 

+ 84 

-46 

- 87 

-115 

- 16 

+65 

<rz' = 68.9 

+ 78* 

+ 50 

+ 29 

- 4 

- 30 

- 87 

-108 

-32 

+ 90 

+ 150* 

+ 90 

-35 

-115 

- 97 

- 27 

+24 

= 77.6 

+ 39 

+ 50 

+ 68* 

+56 

- 18 

-112 

-128 

-44 

+ 86 
+ 51 

+ 144* 
+ 104* 

+ 86 
+ 90 

-19 
- 9 

- 80 
-121 

- 40 

-143 

- 21 
- 50 

0 

+ 73 

GZ’ 

— = 0.888 

+ 122* 

+ 77 

+ 3 

-36 

- 44 

- 55 

- 67 

-35 


+77.3 

+ 103.2 +66.7 

-7.7 

-65.5 

-91.7 

-64.6 

+0.6 



II and III are given in Table IV. Plotted (Fig. 2), the curve for 
<*&/<* z = f(T) shows a maximum at about 8.18 sec. This is the period 
of the dominant frequency present. It is more difficult but not impos¬ 
sible to estimate the period of the less dominant frequency by in spec- 
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tion. Looking at Table I, one notes veiy high values of f(t) at t = 27 
see and t = 43 sec and only one intervening positive maximum at 
t = 34 sec. This maximum is much reduced in magnitude and is nearly 
midw &y between the other two. Further, there are two negative max¬ 
ima in this interval, one each side of the midpoint, and both are inter¬ 
mediate in value. The simple explanation is that both periodicities had 

TABLE IV 


Certain Values Computed from the Data of Table I on the Basis 

of Various Assumed Periodicities Present 



separate positive maxima near the 27 and the 43 positions, that, though 
the 8.18 sec frequency had a positive maximum near the 34 position, 
the less dominant frequency had a negative maximum at that point, 
and that three periods of the unknown frequency are approximately 
equal to two of the known. We should therefore expect the T" of the 
less dominant frequency to be between 5.0 and 5.5 sec. In accord with 
the expectancy just deduced, computations based on various assumed 
values for T", as shown also in Table IV and Fig. 3, indicate the period 
of this frequency, despite the failure of one point to conform with the 
others, to be about 5.19 sec. 

1 he results for an assumed T" of 6.0 sec (Table IV) at some distance 
from 5.19 sec show very definitely that that frequency is not present. 
1 hat the plots of Figs. 2 and 3 should give such definite indications 
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is somewhat a matter of chance. For really satisfactory work, more 
readings per cycle and a greatly increased number of cycles are desired. 

Comparison of (az'/vz) with (<rz"/<?z) on the bases of Eqs. 8 and 9 
indicates (1) that the amplitude for the dominant frequency is twice 



Fig. 2. Values computed, using the data of Table I and Fig. 1, for< jz’/o z for various 

assumed periods in the neighborhood of 8.2 sec. 

that for the less dominant frequency and (2) that no additional fre¬ 
quency having an appreciable amplitude is present. Except for the fact 
that these periodicities are sinusoidal, these conclusions could not be 
deduced without further consideration (see problem 2). 

That the peaks of Figs. 2 and 3 are not more definitely resolved than 
they are is a consequence of the relative smallness of the number of 
terms given in Table I. Were the number doubled the resolution would 
be effectively doubled. The effect is the same as in the resolution of 



Fig. 3. Values computed, using the data of Table I and Fig. 1, for oz"/<j z for various 

assumed periods in the neighborhood of 5.2 sec. 

spectral lines by a grating; the greater the number of grating lines, other 
things the same, the greater is the resolution. 

An alternate procedure for determining T" consists (1) in subtracting 
from the data of Table I values for an assumed periodicity of 8.18 sec 
whose amplitude is 97.4 and whose phase is zero for t = 43 sec, and (2) 
in treating the results thus obtained in the manner that the original 
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data have been treated. This entails more work than the inspection 
method and normally would be used only in case the latter fails. 

4. Determining the Amplitude and Phase Constants. It is advisable, 
in view of the results already gained by inspection, to attempt its appli¬ 
cation further. Looking over Table I once more, it is found that an 
absolute positive maximum value for 2 occurs at position 43. Further, 
the values of 2 for positions 42 and 44 are equal at least to within one 
part in 90. This suggests, despite, if not more strongly because of, the 
readings for positions 58, 59, and 60, that 

a' + a" = 150 [11] 

and that, if t were taken as zero at position 43, then 

r («')' =(O'= i\ [ 12 ] 

L " J43 sec 

Eq. 11 combined with the conclusion reached above that a'/a" equals 
approximately 2, leads to the conclusion that a' and a" may have the 
values 100 and 50 respectively. It is a simple matter to transfer to a 
time origin corresponding to that used in constructing Table I. Doing 
so, we find that 

[6' = —2°] t=0 [13] 

[5" = —2°] <=0 [14] 

From the inspcctional analysis we therefore conclude as an approxi¬ 
mate expression 

* = 100 sin t - 2° ) + 50 sin (—£— t - 2°) [15] 

\8.18sec / \5.19sec / 


Let us compare Eq. 15 with what is obtained by a much more extended 
determination of the four constants a' t a", 8', and 8" by what we ordi¬ 
narily consider the “straightforward” mathematical method, which fol¬ 
lows. We shall make the same assumption as above, namely, that a 
is zero. Although Table IV by its average values for 2 seems to indicate 
that a may be of the order of +1.5, this may well be a consequence of 
the small number of terms. 

For the evaluation of the constants on the proposed basis, it is neces¬ 
sary to rewrite Eq. 1 in the following form 


2 = a + (a' sin 6') cos 


2tt 

V 


t + (a' cos 5') sin 




t + (a" cos 8") sin 




+ (a" sin 8") cos 
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In this form the constants to be determined are a, a' sin 5', a' cos 8 ', 
a” sin 8", and a" cos 6". Selecting five points from Table I, and insert¬ 
ing .the appropriate values for z and t , together with the determined 
values for V and T'\ in Eq. 16 leads to five simultaneous linear equa¬ 
tions connecting the desired constants. Values for them may be deter¬ 
mined by standard methods. 

The authors, assuming a of Eq. 5 to be zero, have carried through 
such computations. The points selected corresponded to t equal to 7, 
18, 34, and 36 sec. In theory any four points could be chosen. These 
were chosen on the basis that for these, position z varied but slowly 
with t. The resultant computed equation is 

z = 85.0 sin t + 250°) + 47.9 sin t + 167°) [17] 

The constants of Eq. 17 do not check well (1) with the conclusion, 
drawn in connection with Table IV and Eq. 8, that the amplitude of 
the first component is twice that of the second, (2) with the original 
data of Table I which shows at 43 sec that the sum of the two ampli¬ 
tudes must be equal at least to 150, nor (3) with the original equation 
used in the construction of Table I, namely 


2tt 


2t r 


z = 100.0 sin — t 50.0 sin — 


t 


[18] 


Eq. 15 arrived at by the inspection method fits much more nearly 
with the construction equation, Eq. 18, than does Eq. 17, which was 
arrived at by straightforward mathematical procedure. That the lattci 
method should fail can be explained on the basis of propagation of pre¬ 
cision indexes (Chap. IX). It perhaps suffices here to say that certain 
procedures, starting with given quantities with moderate given precision 
indexes, tend toward highly precise results for certain other computed 
quantities when carried through in a so-called forward direction, and 
that those same procedures will tend toward greater uncertainty of 
results if the direction is reversed and the former initially given quan¬ 
tities are now the quantities sought in the reversed proceduie. Evalu¬ 
ating a', a", 5', and 5" in terms of given 2 and V and T" is such a back¬ 
ward procedure when contrasted with the forward procedure of finding 
z > given those constants. 

Failing the benefits of an inspection or other method, the host proce¬ 
dure for finding the best equation of the type of Eq. 1 would seem to 
be that of (1) accepting an equation such as Eq. 17 as preliminai}, (2) 
Plotting the resulting curve of deviations, (3) computing the resulting 
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variations for this curve due to separate small variations of T', T", 
a', a", S', and 6", and (4) adjusting the values of these constants to 
yield a minimum standard deviation in accord with Gaussian theory. 

Even with the benefits of assumed possible inspectional method, ad¬ 
justments in accord with the preceding paragraph may be necessary. 

6. Summary. Certain problems involve variations of two or more 
components each having a periodicity of its own unrelated to that of 
the other. When only the added effects of these periodicities can be 
measured, there is need of a procedure for their separate determinations. 

Granted a disturbance of the type 

z = a + a’ sin t + 5'^ + a" sin t + 5H- [1] 

and data for 2 for a long series of equally spaced instants of time, r, 
one first inspects the tabulated data to determine an approximate period 
for one periodicity. If an approximate period is not obtainable thus, 
one must be assumed. 

With a definite assumption of period as m'r where m' is a whole 
number, the data are arrayed as follows: 


Zi 

22 

23 

2 m ' 

Zm' +1 

2 m '+2 

2m'+ 3 

* * * 2 2m ' 

Z2m' -fl 

• 

ft 

22m'+2 

• 

ft 

22 m'+3 

• 

• 

* ‘ ‘ 2 3m / 

• 

A 

• 

z\ 

• 

7' 

A 2 

• 

7' 

3 

• 

7/ 

• • • /j 

/J m 



of which the Z n s represent the averages of the corresponding columns. 
For this array the ratio of two standard deviations is sought, namely 
( jy//(Jz . If this ratio is zero or approximately zero, m'r is not a period 
present in the data nor is it approximately such period. If, however, 
this ratio differs from zero considerably, a period near m'r is present. 
It then becomes necessary to array the data corresponding to periods 
of (m' zt e')r of which e' is a proper fraction. The procedure for this, 
involving the elimination of certain of the 2 ’s according to an ordered 
plan, is described in the text. The ratios oz'/oz for several such arrays 
are separately determined. The value of (m' ± €')r corresponding to 
a maximum for this ratio is a frequency sought. Other frequencies are 
similarly determined bv seeking maxima of the ratio in other regions of 
assumed frequencies. 
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In case the periodicities are sinusoidal the ratios <Jzhz are in propor¬ 
tion to their amplitudes and the sum of their squares is unity. Pro¬ 
cedures for determining actual amplitudes and phase relations for the 

component periodicities are discussed. 

% 

PROBLEMS 

1. Taking from the data of Table I those which are necessary separately for 13 
and 14 cycles, compute two values for oz"l a z corresponding to T" = 5.31 sec. \\ hat 
is your conclusion? 

2. When two periodic functions of the straight-side saw tooth type with different 
frequencies and amplitudes are combined, what are the expected relations corre¬ 
sponding to those of Kqs. 8 and 9? What generalization may be made? 



THE JAMMU & KASHMIR UNIVERSITY 

LIBRARY. 


DATE LOANED 

Class No._Book No. _ 

Vol._Copy_ 

Accession No._ 


APPENDIX 1 


BRIEF DISCUSSION OF DETERMINANT METHODS 


Introduction. Throughout this text determinants are used (1) in the solu¬ 
tion of simultaneous equations and (2) in the determination of the equations of 
curves of selected types that pass through selected points. To the authors they 
represent much time saved and simplified, generalized procedures. Recognizing, 
however, that many users of this text will not have ,the necessary preparation, 
simple though it is, we here present without discussion of underlying theory the 
simple procedures for carrying out the two processes indicated above. 

The Solution of Simultaneous Equations. Consider the determinant solu¬ 
tion for the following three equations. 

Sx + 2y - z - 19 


In determinant form they are 


2x — Qy — z = 7 
5x — 4y + 3z = 1 


x = 


y = 


z = 


19 

2 

-1 

7 

-6 

-1 

1 

-4 

3 

3 

2 

-1 

2 

-6 

-1 

5 

-4 

3 

3 

19 

-1 

2 

7 

-1 

5 

1 

3 

3 

2 

-1 

2 

-6 

-1 

5 

-4 

3 

3 

2 

19 

2 

-6 

l 

5 

-4 

1 

3 

2 

-1 

2 

-6 

-1 

5 

-4 

309 
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[ 1 ] 

[ 2 ] 

[3] 


[4] 


[5] 


[6] 
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The denominators are the same and consist of a determinant composed of the 
coefficients of x, y, and z in Eqs. 1, 2, and 3 arrayed in the order appearing there. 
The numerator determinant for x differs only in that the coefficients of x in 
Eqs. 1, 2, and 3 are replaced by the numerics on the right of the equality signs. 
The numerators for y and z are similarly determined. In case there are four 
or more unknowns, expressions similar to the above may be written for their 
values. Each unknown will be represented by the ratio of two determinants. 
For the convenient evaluation of these determinants, there are several rules 
which we shall discuss in general terms previous to obtaining the numerical 
values ordinarily desired for the three unknowns. 

The Evaluation of Determinants. Let us consider in succession the gen¬ 
eralized procedures for evaluating determinants of the (1) second, (2) third, and 
(3) higher orders. 

The standard form for the second order determinant and its algebraic equiv¬ 
alents are shown in the following equations: 


dl 02 

bi b 2 


o 1^2 — <* 2^1 



The standard form for a third order determinant is 


0\ 

02 

Oz 

bi 

b2 

bz 

Cl 

Cl 

C 3 



There are two convenient methods to evaluate it. 

According to one method, the operator either draws, or sees drawn in his 
mind’s eye, lines as indicated in the following form: 



In the evaluation the determinant is equated to the sum of the products of items 
connected by the lines. In this equating one takes as positives the products of 
terms connected by the lines sloping generally downward to the right and as 
negative the products of terms connected by the lines sloping generally down¬ 
ward to the left. Thus we have 


a\ 02 0 % 

bi &2 bz 

Ci C2 Cz 


O I& 2 C 3 02bzCl -f Ozb\C 2 — 0\bzC2 — 02b\Cz — Qzb^Cl 



As a general characteristic of the terms of the algebraic equivalent of the deter¬ 
minant, it is seen that each row and column is represented in every such term. 
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The second method is based on the breaking up of the determinant into second- 
order determinants as follows: 

Ql 02 03 7 , ,7 7 7 

02 O3 01 63 Oi 02 

61 62 63 = Gl — 02 + 03 [ 9 ] 

C 2 C3 Ci C3 Ci C2 

Cl c 2 c 3 

Expansion of these second-order determinants leads at once to the expression 
given above. These smaller determinants in order are called minors of the ■ 
terms Oi, 02, and a 3 . Note that, in the expansion of the main determinant in 
terms of minors, the signs are alternately positive and negative and that the 
first sign is positive. For the one who makes considerable use of determinants, 
the first method is commonly used when a determinant of the third order is to 
be evaluated. 

Consider next the evaluation of a determinant of the fourth or higher order. 
The method of Array B cannot be used. Instead we use that given above as the 
second method for the third order determinant. Thus we have 

62 63 b 4 &i &3 b 4 bi b 2 64 61 62 b 3 

a\ C2 c 3 C4 — (12 Ci c 3 C4 + a 3 Ci C2 C4 — <14 Ci C2 c 3 [10] 

d 2 dz d 4 di dz d 4 d\ d 2 d 4 c/i do dz 

of which the third order determinants are to be evaluated as above. Note the 

alternate changing of signs. Writing \(iib 2 Czd 4 \ for the main determinant and 
A 1, A 2, Az, and A4 as the minors to the elements a 1, a 2 , (iz, and a 4 , we have as 
an abbreviated form 

aib 2 czdi\ = a\A\ — a 2 A 2 + ^3*13 — O4A4 [ 11 ] 

According to another method of breaking up, we may write 

|ai&2C3d4( = d\A\ — b\B\ + ciCi — d\D\ [ 12 ] 

There are six other methods in fact. Based for instance on the second column, 
we write 

|ai&2C3d4| — — o 2 A 2 + b 2 B 2 — c 2 C 2 -f d 2 D 2 [ 13 ] 

The sign of any term depends on the location in the determinant of the item 
preceding the minor. These are shown in the following array: 

-f — + — 

- + - + 

+ - + - 
- + - + 



0 .1 a 2 az <24 
bi b 2 bz b\ 

Cl C2 C 3 C4 

d\ d 2 dz d\ 
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Rules for the Simplification of Determinants. The time required to evalu¬ 
ate a determinant is often much lessened by the application of certain rules 
which we shall state without giving proof. They are: 

( 1 ) If, from a row or column of a determinant, a common factor may be 
removed, that determinant may be equated to the product of that factor and 
the determinant with that factor eliminated from the row or column in ques¬ 
tion. Thus 


3 

2 

-1 


3 

1 

-1 

2 

-6 

-1 

= 2 

2 

-3 

-1 

5 

-4 

3 


5 

-2 

3 



(2) The elements of one row or column may all be multiplied by a constant 
and added to or subtracted from the corresponding elements of another row or 
column without changing the value of the determinant. Thus 



The first row was first subtracted from the second and then multiplied by 3 
and added to the last row. The advantage for the evaluation has been the intro¬ 
duction of zeros. 

( 3 ) If the elements of a row or a column of a determinant are all zeros with 
one exception, the determinant may be equated to the product of that element 
and its minor with the appropriate sign derived from array C. Thus we have 


3 1 

-1 -4 

14 1 



-1 

-4 


1 4 

14 

1 


14 1 



the last step following rule 1 . Evaluated in accord with Eq. 7 , the last deter¬ 
minant yields — 55 . Accordingly the original determinant of Eq. 14 and the 
denominators of Eqs. 4 , 5 , and 6 are equal to — 110 . 

( 4 ) If two rows or two columns of a determinant are equal or the elements 
of one are in direct proportion to those of the other, the value of the deter¬ 
minant is zero. Thus 


6 

4 

to 


6 

4 

2 

CO 

4 

CO 

— 

GO 

4 

3 

9 

6 

3 


0 

0 

0 




a consequence in fact of rule 2 and of the general characteristic of the terms to 
which a determinant may be equated as noted above in connection with Eq. 8. 
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Applying the general and special rules for the evaluation of the determinants 
of Eqs. 4, 5, and 6, one obtains 


a 

II 

1 

O 

II 

[ 18 ] 

-110 


II 

o o 

r-H rH 
t—4 

1 1 

II 

[ 19 ] 

550 

z =- = —o 

[20] 

-110 



Were all sets of simultaneous equations which are to be solved of no higher 
order than three and were the coefficients always simple whole numbers, it is 
doubtful that the time-saving feature of determinants would be of much value. 
When, however, the order is higher than three and the coefficients are not 
simple, there is no question but that the determinant method is advisable. 
There are additional special rules which have been developed and proved. 

We shall not have need for them, however. 

Equations of Specific Curves by the Determinant Method. The determi¬ 
nant procedure for the determination of the equation of a specific curve is the 
same whatever the general form may be. For the straight line of the form 

1 / + a + bx = 0 [21] 


passing through points (3,5) and (0,2), for instance, the equation is 


y i x 

5 1 3 
2 1 G 




Reduced to an algebraic form 
outlined above, this yields 

y 


in conformity with the procedures and rules 
- 8 + x = 0 B»] 


For the third-degree equation of the form 

y + a + bx 4- cx 2 + dx z = 0 [ 24 1 

passing through four points (corresponding to the four arbitrary constants) 
namely (0,2), (2,5), (4,10), and (0,12), the equation is 


V 

1 

X 

o 

x~ 

X 3 

2 

1 

0 

0 

0 

5 

1 

2 

4 

8 

10 

1 

4 

1 G 

G 4 

12 

1 

G 

3 G 

21 G 



The determination of the algebraic form is left to the reader. 
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For an equation of the form 

y 2 + ay -f- b + cx -f dx 2 — 0 ' [26] 

passing through the points listed above for Eqs. 24 and 25 the equation is 
similarly 

y 2 y l x x 2 

4 2 10 0 

25 5 1 2 4 = 0 [27] 

100 10 1 4 16 

144 12 1 6 36 

The determination of the algebraic form is left to the reader. 

The occurrence of a column each element of which is unity may be slightly 
disturbing at first. Its presence is understood when it is seen that these de¬ 
terminants are composed entirely of the coefficients of the undetermined con¬ 
stants and of the constant arbitrarily taken as unity and that the so-called 
constant term of Eq. 26 for instance may be viewed as bx° or by 0 or a combina¬ 
tion and that x° and y° are unity. 

Often in the determination of equations, the operator may select certain con¬ 
venient points for his purpose. So doing, the necessary computations may be 
greatly abbreviated. If additionally certain simplifying changes of variables 
may be employed, an additional reduction in computational effort sometimes 
results. Illustrating these procedures, we shall consider the data of Table I 
wherein is presented the time-temperature relation f~r the constantly stirred 
liquid of a calorimeter to which heat was supplied electrically at a constant rate. 

TABLE I 

Data Showing the Time-Temperature Relation for the Liquid of a 
Calorimeter Supplied with Heat at a Constant Rate 


t in min 

T in °C 

t in min 

T in °C 

0 

20.95 

9 

34.65 

1 

22.60 

10 

36.10 

2 

24.20 

11 

37.50 

3 

25.75 

12 

38.90 

4 

27.30 

13 

40.30 

5 

28.80 

14 

41.70 

6 

30.30 

15 

43.05 

7 

31.75 

16 

44.40 

8 

33.20 




Let the purpose be that of determining values of dT/dt for various temperatures 
such as 25° C, 30° C, 35° C and 40° C. We first seek T = f(t) and for the rela¬ 
tion let us assume 


T = To + at + bt 2 


[28] 
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Making use of the selected-points method, which is described fully in Chapter 
III of the text, we select points corresponding to 2 min, 8 min, and 14 min as 
fairly representative of three roughly equal groups into which the data may be 
divided. The determinant equation, disregarding the units of measurement, 
that results is 

T 

24.20 

33.20 
41.70 


1 

1 


t 

2 

8 


( 2 

4 

64 


1 14 196 


= 0 


[29] 


This may be solved directly, but let us introduce certain new simplifying, di¬ 
mensionless variables, e.g. 



T - 33.20° C 
1C° 



and 

t — 8 min 

* = — - 

6 mm 

Rewritten, Eq. 29 becomes 


y 1 xx 2 

-9.00 1-11 

.00 1 0 0 

8.50 1 1 1 





This simplifies at once, in view of rule 3 above, to 


which at once reduces to 


y 

-9.00 

8.50 



-1 1 

1 1 



y = 8.75a; - 0.25x 2 


[33] 

[34] 


Verification shows that no computational error has been made. How well the 
equation fits the data as a whole may be determined easily. Differentiation 
leads to 


— = 8.75 - 0.50a; 
dx 



For dT/dt, the quantity desired, we have 

dT _ dy dx dT 
dt dx dt dy 


[36] 
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Substitution, for the condition that t = 5 min, leads to a desired result, namely 

( dT\ 1 p° 

— ) = (8.75 + 0.25) —V 1 C° = 1.50 — [37] 

at / 5 mm 6 min min 

Other values for dT/dt follow quickly. Obviously with slight practice, one will 
see that the writing down of Eqs. 29 and 32 is needless. Possibly also he will 
be able to obtain Eq. 34 from Eq. 33, if written at all, by inspection. It is 
evident, however, that the selection and the change-of-variables procedures may 
simplify computations greatly. 


PROBLEMS 

1. Solve the following equations for x, y , and z. 

2x + 3y + 2 = 0 
x + y + 2z = 5 
x - z = 2 

2. Solve the following equations: 
w+x-\-y+z = b 

w + y = 2 

x + y + z = 4 
w -{- z = 1 

3. Find equations for straight lines passing through points 

(a) (3,0) and (2,9); 

(b) (0,4) and (6,0); 

(c) (-2,3) and (3,-4). 

4. Find equations for a line of type y = a + bx -p cx 2 through 

(a) (0,0), (4,6), and (12,6); 

(b) (-3,0), (2,-6), and (7,-10); 

(c) (-3,0), (2,-6), and (7,2). 

6. Find equations for a circle passing through the points 

(a) (0,0), (2,2), and (4,8); 

(b) (-4,3), (3,-4), and (4,3). 

6. Find the equation of the conic passing through the points (0,0), (2,2), (4,8), 
(2,12), and (-2,8). 

7. (a) Express Eq. 25 in its normal algebraic form. (6) Express Eq. 27 in its 
normal algebraic form. 

8. Using the data of Table I, but selecting values corresponding to 3, 8, and 13 min, 
determine values for dT/dt corresponding to t = 5 min, 10 min, 15 min. Check the 
value for 5 min with that given in the text. 

9. Using the data of Table I, determine an equation of the form of T = 
Ty) -p at -f- bt 2 + c/ 3 to fit the data. Also determine dT/dt for t = 5 min. 
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TABLES 
TABLE 1 1 

The Probability Coefficient yh X for the Normal Distribution Curve 

y hx = — e~ hix * as a Function of hx 

v * 

Frequently in tables values of 2y hx are given in place of \jh x 

To obtain values of y x /„ as a function of x/v, determine in order for each given x/<r, 
a corresponding hx (= x/yf2o), a yi, x as given by the table, and y x / a (= hayh x 
= Vh x /V 2). To obtain values of y x ' p as a function of x/p, determine in order for 
each given x/p a corresponding hx (= 0.477 x/p), a yh x as given by the table, and 
a y x / p (= hp y hz = 0.477 yhx)- To obtain values of y x as a function of x, one must 
have a value for h, <r, or p. Given h . determine, for each given x, a correspond¬ 
ing hx, a yh X as given by the table, and a y x (= hy hx )- 


hx 

.00 

.01 

.02 

.03 

.04 

.05 

.06 

.07 

.08 

.09 

Diff. 

H 

0.5642 

0.5641 

0.5640 

0.5637 

0.5633 

0.5628 

0.5622 

0.5614 

0.5606 

0.5596 

0.0006 

iri 

.5586 

.5574 

.5561 

.5547 

.5532 

.5516 

.5499 

.5481 

.5462 

.5442 

.0017 

w)m 

.5421 

.5398 

.5375 

.5351 

.5326 

.5300 

.5273 

.5245 

.5216 

.5187 

.0026 

mm 

.5156 

.5125 

.5093 

.5060 

.5026 

.4991 

.4956 

.4920 

.4883 

.4846 

.0035 

0.4 

.4808 

.4769 

.4730 

.4689 

.4649 

.4608 

.4566 

.4524 

.4481 

.4438 

.0041 

0.5 

.4394 

.4350 

.4305 

.4260 

.4215 

.4169 

.4123 

.4077 

.4030 

.3983 

.0046 

0.6 

.3936 

.3889 

.3841 

.3794 

.3746 

.3698 

.3650 

.3601 

.3553 

.3505 

.0048 

0.7 

.3456 

.3408 

.3360 

.3311 

.3263 

.3215 

.3166 

.3118 

.3070 

.3023 

.0048 

0.8 

.2975 

.2927 

.2880 

.2833 

.2786 

.2739 

.2693 

.2647 

.2601 

.2555 

.0047 

0.9 

.2510 

.2465 

.2420 

.2376 

.2332 

.2288 

.2245 

.2202 

.2159 

.2117 

.0043 

1.0 

.2076 

.2034 

.1993 

.1953 

.1913 

.1873 

.1834 

.1796 

.1757 

.1720 

.0039 

1.1 

.1682 

.1646 

.1609 

.1574 

.1538 

.1503 

.1469 

.1435 

.1402 

.1369 

.0035 

1.2 

.1337 

.1305 

.1274 

.1243 

.1212 

.1183 

.1153 

.1124 

.1096 

.1068 

.0030 

1.3 

.1041 

.1014 

.0988 

.0962 

.0937 

.0912 

.0887 

.0864 

.0840 

.0817 

.0025 

1.4 1 

.0795 

.0773 

.0751 

.0730 

.0709 

.0689 

.0669 

.0650 

.0631 

.0613 

.0020 

1.5 

.0595 

.0577 

.0560 

.0543 

.0527 

.0511 

.0495 

.0480 

.0-165 

.0450 

.0016 

1.6 

.0436 

.0422 

.0409 

.0396 

.0383 

.0371 

.0359 

.0347 

.0335 

.0324 

.0012 

1.7 

.0314 

.0303 

.0293 

.0283 

.0273 

.0264 

.0255 

.0246 

.0237 

.0229 

.0009 

1.8 

.0221 

.0213 

.0206 

.0198 

.0191 

.0184 

.0177 

.0171 

.0165 

.0159 


1.9 

.0153 

.0147 

.0141 

.0136 

.0131 

.0126 

.0121 

.0116 

.0112 

.0108 


hx 

0.0 

0.1 

0.2 

0.3 

0.4 

0.5 

0.6 

0.7 

0.8 

0.9 

Diff. 

2.0 

.0103 

.0069 

.0045 

.0028 

.0018 

.0011 

.0007 

.0004 

.0002 

.0001 

.0010 


1 This table is based on Table s of Probability Functions, Vol. 1. Federal Works Agency, Work Projects 
Administration for the City of New York, 1941, sponsored by the National Bureau of Standards. 
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TABLE II i 

Values of the Probability Integral Phx ^ 

as a Function of hx 


Frequently in tables, this integral is designated by P t . The P x / a corresponding to a 
given x/a limit is the Phx of the table which corresponds to the hx (= x/y/2a) 
for the given x/o limit. The P x / p corresponding to a given x/p limit is the Phx of 
the table which corresponds to the hx (= 0.477 x/p) for the given x/p limit. The 
P z corresponding to a given x-limit is obtainable only if the appropriate value for h, 
a, or p is known. Given h, it may be read from the table as the Phx corresponding 
to the hx for the given z-limit. 



hx 

.00 

.01 

.02 

.03 

.04 

.05 

.06 

.07 

.08 

.09 

Diff. 

0.0 


0.0113 

0.0226 

0.0338 

0.0451 

0.0564 

0.0676 

0.0789 

0.0901 

0.1013 

0.0112 

0.1 

.1125 

.1236 

.1348 

.1459 

.1569 

.1680 

.1790 

.1900 

.2009 

.2118 

.0110 


.2227 

.2335 

.2443 

.2550 

.2657 

.2763 

.2869 

.2974 

.3079 

.3183 

.0106 

mSM 

.3286 

.3389 

.3491 

.3593 

.3694 

.3794 

.3893 

.3992 

.4090 

.4187 

.0100 

0.4 

.4284 

.4380 

.4475 

.4569 

.4662 

.4755 

.48-17 

.4937 

.5027 

.5117 

.0092 

0.5 

.5205 

.5292 

.5379 

.5465 

.5549 

.5633 

.5716 

.5798 

.5879 

.5959 

.0083 

0.6 

.6039 

.6117 

.6194 

.6270 

.6346 

.6420 

.6494 

.6566 

.6638 

.6708 

.0074 

0.7 

.6778 

.6847 

.6914 

.6981 

.7047 

.7112 

.7175 

.7238 

.7300 

.7361 

.0064 

0.8 

.7421 

.7480 

.7538 

.7595 

.7651 

.7707 

.7761 

.7814 

.7867 

.7918 

.0055 

0.9 

.7969 

.8019 

.8068 

.8116 

.8163 

.8209 

.8254 

.8299 

.8342 

.8385 

.0046 

1.0 

.8427 

.8468 

.8508 

.8548 

.8586 

.8624 

.8661 

.8698 

.8733 

.8768 

.0038 

1.1 

.8802 

.8835 

.8868 

.8900 

.8931 

.8961 

.8991 

.9020 

.9048 

.9076 

.0030 

1.2 

.9103 

.9130 

.9155 

.9181 

.9205 

.9229 

.9252 

.9275 

.9297 

.9319 

.0024 

1.3 

.9340 

.9361 

.9381 

.9400 

.9419 

.9438 

.9456 

.9473 

.9490 

.9507 

.0018 

1.4 

.9523 

.9539 

.9554 

.9569 

.9583 

.9597 

.9611 

.9624 

.9637 

.9649 

.0014 

1.5 

.9661 

.9673 

.9684 

.9695 

.9706 

.9716 

.9726 

.9736 

.9745 

.9755 

.0010 

1.6 

.9763 

.9772 

.9780 

.9788 

.9796 

.9804 

.9811 

.9818 

.9825 

.9832 

.0007 

1.7 

.9838 

.9844 

.9850 

.9856 

.9861 

.9867 

.9872 

.9877 

.9882 

.9886 

.0005 

1.8 

.9891 

.9895 

.9899 

.9903 

.9907 

.9911 

.9915 

.9918 

.9922 

.9925 

.0004 

1.9 

.9928 

.9931 

.9934 

.9937 

.9939 

.9942 

.9944 

.9947 

.9949 

.9951 

.0003 

hx 

0.0 

0.1 

0.2 

0.3 

0.4 

0.5 

0.6 

0.7 

0.8 

0.9 



.9953 

.9970 

.9981 

.9989 

.9993 

.9996 

.9998 

.9999 

.9999 

.99995 



1 This table is based on Tables of Probability Functions, Vol. 1, Federal Works Agency, Work Projects 
Administration for the City of New York, 1941, sponsored by the National Bureau of Standards. 
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TABLE III 

Chauvenet’s Criterion. Limiting Values of hx t x/a> and x/p Corresponding 
to Various Numbers of Items, n, for the Exclusion of an Item from a Set 
on the Basis that, in Comparison with the Other Items, it Exerts too Great 

an Influence on Computed Values 


n 

hx 

x/<r 

x/p 

n 

hx 

X/0 

x/p 

5 

1.16 

1.68 

2.44 

20 

1.58 

2.24 

3.32 

6 

1.22 

1.73 

2.57 

22 

1.61 

2.28 

3.38 

7 

1.27 

1.79 

2.68 

24 

1.63 

2.31 

3.43 

8 

1.32 

1.86 

2.76 

26 

1.66 

2.35 

3.47 

9 

1.35 

1.92 

2.84 

30 

1.69 

2.39 

3.55 

10 

1.39 

1.96 

2.91 

40 

1.77 

2.50 

3.70 

12 

1.44 

2.03 

3.02 

50 

1.82 

2.58 

3.82 

14 

1.49 

2.10 

3.12 

100 

1.98 

2.80 

4.16 

16 

1.52 

2.16 

3.20 

200 

2.14 

3.02 

4.48 

18 

1.56 

2.20 

3.26 

500 

2.33 

3.29 

4.88 













TABLE IV 1 

Showing Values of x 2 Corresponding to Listed Values of P x * and n', Where n' is the Number of Groups into Which the 

Data are Divided Less the Number of Imposed Conditions 
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For larger values of n, the expression y ^2\ 2 — v ^2n — 1 may be used as a normal deviate with unit variance. 
1 From R. A. Fisher, Statistical Methods for Research Workers, London, Oliver & Boyd, 1938. 
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TABLE V 1 


Showing Values of Correlation Coefficient r Corresponding to Various 

Values of Fisher’s z-Function 


z ' .01 

.02 

.03 .04 

.05 

.06 

.07 

.08 

.09 

.10 

0.0 0.0100 

0.0200 

0.0300 0.0400 

0.0500 

0.0599 

0.0699 

0.0798 

0.0898 

0.0997 

0.1 .1096 

.1194 

.1293 .1391 

.1489 

.1586 

.1684 

.1781 

.1877 

.1974 

0.2 .2070 

.2165 

.2260 .2355 

.2449 

.2543 

.2636 

.2729 

.2821 

.2913 

0.3 .3004 

.3095 

.3185 .3275 

.3364 

.3452 

.3540 

.3627 

.3714 

.3800 

0.4 .3885 

.3969 

.4053 .4136 

.4219 

.4301 

.4382 

.4462 

.4542 

.4621 

0.5 .4699 

.4777 

.4854 .4930 

.5005 

.5080 

.5154 

.5227 

.5299 

.5370 

0.6 .5441 

.5511 

.5580 .5649 

.5717 

.5784 

.5850 

.5915 

.5980 

.6044 

0.7 .6107 

.6169 

.6231 .6291 

.6351 

.6411 

.6469 

.6527 

.6584 

.6640 

0.8 .6696 

.6751 

.6805 .6S58 

.6911 

.6963 

.7014 

.7064 

.7114 

.7163 

0.9 .7211 

.7259 

.7306 .7352 

.7398 

.7443 

.7487 

.7531 

.7574 

.7616 

1.0 .7658 

.7699 

.7739 .7779 

.7818 

.7857 

.7895 

.7932 

.7969 

.8005 

1.1 .8041 

.8076 

.8110 .8144 

.8178 

.8210 

.8243 

.8275 

.8306 

.8337 

1.2 .8367 

.8397 

.8426 .8455 

.8483 

.8511 

.8538 

.8565 

.8591 

.8617 

1.3 .8643 

.8668 

.8692 .8717 

.8741 

.8764 

.8787 

.8810 

.8832 

.8854 

1.4 .8875 

.8896 

.8917 .8937 

.8957 

.8977 

.8996 

.9015 

.9033 

.9051 

1.5 .9069 

.9087 

.9104 .9121 

.9138 

.9154 

.9170 

.9186 

.9201 

.9217 

1.6 .9232 

.9246 

.9261 .9275 

.9289 

.9302 

.9316 

.9329 

.9341 

.9354 

1.7 .9366 

.9379 

.9391 .9402 

.9414 

.9425 

.9436 

.9447 

.9458 

.94681 

1.8 .94783 

.94884 

.94983 .95080 

.95175 

.95268 

.95359 

.95449 

.95537 

.95624 

1.9 .95709 

.95792 

.95873 .95953 

.96032 

.96109 

.96185 

.96259 

.96331 

.96403 

2.0 .96473 

.96541 

.96609 .96675 

.96739 

.96803 

.96865 

.96926 

.96986 

.97045 

2.1 .97103 

.97159 

.97215 .97269 

.97323 

.97375 

.97426 

.97477 

.97526 

.97574 

2.2 .97622 

.97668 

.97714 .97759 

.97803 

.97846 

.97888 

.97929 

.97970 

.98010 

2.3 .98049 

.98087 

.98124 .98161 

.98197 

.98233 

.98267 

.98301 

.98335 

.98367 

2.4 .98399 

.98431 

.98462 .98492 

.98522 

.98551 

.98579 

.98607 

.98635 

.98661 

2.5 .98688 

.98714 

.98739 .98764 

.98788 

.98812 

.98835 

.98858 

.98881 

.98903 

2.6 .98924 

.98915 

.98966 .98987 

.99007 

.99026 ' 

.99045 

.99064 

.99083 

.99101 

2.7 .99118 

.99136 

.99153 .99170 

.99186 

.99202 

.99218 

.99233 

.99218 

.99263 

2.8 .99278 

.99292 

.99306 .99320 

.99333 

.99346 

.99359 

.99372 

.99384 

.99396 

2.9 .99108 

.99120 

.99431 .99443 

.99454 

.99464 

.99475 

.99485 

.99495 

.99505 


For greater accuracy, and for values beyond the table, 


r = (e 22 - 1) 4- (c 22 + 1) 

* = J$fln (1 + r) - In (1 - r)J 

1 From It. A. Fisher, Statistical Methods far Hcscarch Workers, London, Oliver & Boyd, 1938. 
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TABLE VI 

Showing the Makeup of the Constants of the Least-Squares Equation of 
the Type y = a + bx + cx 2 + dx 3 for Equations of Varying Degrees When 
the Abbreviated Method of Baily 1 and of Cox and Matuschak 2 is Used 

This method is applicable only when succeeding values of x have a common differ¬ 
ence and are equally weighted. The independent variable, changed if necessary, 
must have a zero value at the midpoint of the series with succeeding values dif¬ 
fering by unity if the number of terms is odd and by two if even. Values for the 
various k' s, as computed by Cox and Matuschak, are to be found in Tables VII 


and VIII of this appendix. 

Degree of 

Parameters 

Equation 

a 

b 

c 

d 

1 

2 

3 

kiZy 

k£y - k\Zx 2 y 
A- 3 2t/ - k£x 2 y 

kiZxy 

kiLxy 

k£Zxy — ki ~x*y 

k£x 2 y - ki'Zy 
k£x 2 y - k\Zy 

k&Zx^y - k 7 Zxy 

1 Baily, J. I 

2 Cox, G. J. 

... Ann . Math . Statistics , 2, 355 (1931). 

, and Matuschak, M. C., J. Phys . Chem ., 45 , 362 (1941). 
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TABLE VIII 

Valies of the Constants, k n , Entering Least-Squares Solutions, Using the Abbreviated Method of Baily and Cox and 

Matuschak, When the Number of Terms, n , is Even 
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TABLE IX 


n n 

Sums of Integers and of Squares of Integers 


m= 1 


m- 1 


for Use in Least-Squares Solutions 


n 

x> 

m =» 1 

m= 1 

n 

——— - — - 

m= 1 

X > 2 

m = 1 

1 

i 

i 

26 

351 

6,201 

2 

3 

5 

27 

378 

6,930 

3 

6 

14 

28 

406 

7,714 

4 

10 

30 

29 

435 

8,555 

5 

15 

55 

30 

465 

9,455 

6 

21 

91 
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10,416 

7 

28 
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11,440 
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204 
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25,585 

18 
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27,434 

19 
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2,470 

44 
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29,370 

20 

210 

2,870 

45 

1,035 

31,395 

21 

231 

3,311 

40 

1,081 

33,511 

22 

253 

3,795 

47 

1,128 

35,720 

23 

276 

4,324 

48 

1,170 

38,024 

24 

300 

4,900 

49 

1,225 

40,425 

25 

325 

5,525 

50 

1,275 

42,925 
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i 


TABLE X 


Logarithms to the Base e 


These two pages give the natural (hy¬ 
perbolic, or Napierian) logarithms of 
numbers between 1 and 10, correct to 
four places. Moving the decimal point 
n places to the right (or left) in the num¬ 
ber is equivalent to adding n times 2.3026 
(or n times 3.607-1) to the logarithm. 


1 

2.3026 

1 

0.6974-3 

2 

4.6052 

2 

0.3948-5 

3 

6.9078 

3 

0.0922-7 

4 

9.2103 

4 

0.7897-10 

5 

11.5129 

5 

0.4871-12 

6 

13.8155 

6 

0.1845-14 

7 

16.1181 

7 

0.8819-17 

8 

18.4207 

8 

0.5793-19 

9 

20.7233 

9 

0.2767-21 
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Tabular Difference 

1 2 3 4 5 

1.0 

0.0000 

0100 
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0296 

0392 

0488 

0583 

0677 

0770 

0862 

0.0953 

10 19 29 38 48 

1.1 

0953 

1044 

1133 

1222 

1310 

1398 

1484 

1570 

1655 

1740 

1823 

9 17 28 35 44 

1.2 

1823 

1906 

1989 

2070 

2151 

2231 

2311 

2390 

2469 

2546 

2624 

8 16 24 32 40 

1.3 

2624 

2700 

2776 

2852 

2927 

3001 

3075 

3148 

3221 

3293 

3365 

7 15 22 30 37 

1.4 

3365 

3436 

3507 

3577 

3646 

3716 

3784 

3853 

3920 

3988 

4055 

7 14 21 28 34 

1.5 

4055 

4121 

4187 

4253 

4318 

4383 

4447 

4511 

4574 

4637 

4700 

6 13 19 26 32 

1.6 

4700 

4762 

4824 

4886 

4947 

5008 

5068 

5128 

5188 

5247 

5306 

6 12 18 24 30 

1.7 

5306 

5365 

5423 

5481 

5S39 

5596 

S6S3 

5710 

S766 

5822 

5878 

6 11 17 23 29 

1.8 

5878 

5933 

5988 

6043 

6098 

6152 

6206 

6259 

6313 

6366 

6419 

5 11 16 22 27 

1.9 

6419 

6471 

6523 

6575 

6627 

6678 

6729 

6780 

6831 

6881 

0.6931 

5 10 IS 2126 

2.0 

0.6931 

6981 

7031 

7080 

7129 

7178 

7227 

7275 

7324 

7372 

7419 

5 10 15 20 24 

2.1 

7419 

7467 

7514 

7561 

7608 

7655 

7701 

7747 

7793 

7839 

7885 

5 9 14 19 23 

2.2 

7885 

7930 

7975 

8020 

8065 

8109 

8154 

8198 

8242 

8286 

8329 

4 9 13 18 22 

2.3 

8329 

8372 

8416 

8459 

8502 

8544 

8587 

8629 

8671 

8713 

8755 

4 9 13 17 21 

2.4 

8755 

8796 

8838 

8879 

8920 

8961 

9002 

9042 

9083 

9123 

9163 

4 8 12 16 20 

2.5 

9163 

9203 

9243 

9282 

9322 

9361 

9400 

9439 

9478 

9517 

9555 

4 8 12 16 20 

2.6 

9555 

9594 

9632 

9670 

9708 

9746 

9783 

9821 

98S8 

9895 

0.9933 

4 8 11 15 19 

2.7 

0.9933 

9969/0006 

0043 

0080 

0116 

0152 

0188 

0225 

0260 

1.0296 

4 7 11 IS 18 

2.8 

1.0296 

0332 

0367 

0403 

0438 

0473 

0508 

0543 

0578 

0613 

0647 

4 7 11 14 18 

2.9 

0647 

0682 

0716 

0750 

0784 

0818 

08S2 

0886 

0919 

0953 

1.0986 

3 7 10 14 17 

3.0 

1.0986 

1019 

1053 

1086 

1119 

1151 

1184 

1217 

1249 

1282 

1314 

3 710 13 16 

3.1 

1314 

1346 

1378 

1410 

1442 

1474 

1506 

1537 

1569 

1600 

1632 

3 6 10 13 16 

3.2 

1632 

1663 

1694 

1725 

1756 

1787 

1817 

1848 

1878 

1909 

1939 

3 6 9 12 IS 

3.3 

1939 

1969 

2000 

2030 

2060 

2090 

2119 

2149 

2179 

2208 

2238 

3 6 9 12 IS 

3.4 

2238 

2267 

2296 

2326 

23S5 

2384 

2413 

2442 

2470 

2499 

2528 

3 6 9 12 14 

3.5 

2528 

2556 

2585 

2613 

2641 

2669 

2698 

2726 

2754 

2782 

2809 

3 6 8 11 14 

3.6 

2809 

2837 

2865 

2892 

2920 

2947 

2975 

3002 

3029 

3056 

3083 

3 5 8 11 14 

3.7 

3083 

3110 

3137 

3164 

3191 

3218 

3244 

3271 

3297 

3324 

3350 

3 5 8 11 13 

3.8 

3350 

3376 

3403 

3429 

3455 

3481 

3507 

3533 

3S58 

3584 

3610 

3 5 8 10 13 

3.9 

3610 

3635 

3661 

3686 

3712 

3737 

3762 

3788 

3813 

3838 

1.3863 

3 5 8 10 13 

4.0 

1.3863 

3888 

3913 

3938 

3962 

3987 

4012 

4036 

4061 

4085 

4110 

2 5 7 1012 

4.1 

4110 

4134 

4159 

4183 

4207 

4231 

4255 

4279 

4303 

4327 

4351 

2 5 7 10 12 

4.2 

4351 

4375 

4398 

4422 

4446 

4469 

4493 

4516 

4540 

4563 

4586 

2 5 7 9 12 

4.3 

4586 

4609 

4633 

4656 

4679 

4702 

4725 

4748 

4770 

4793 

4816 

2 5 7 9 11 

4.4 

4816 

4839 

4861 

4884 

4907 

4929 

4951 

4974 

4996 

5019 

5041 

2 4 7 9 11 

4.5 

5041 

5063 

5085 

S107 

5129 

5151 

5173 

5195 

5217 

5239 

5261 

2 4 7 9 11 

4.6 

5261 

5282 

5304 

5326 

5347 

5369 

5390 

5412 

5433 

5454 

5476 

2 4 6 9 11 

4.7 

5476 

5497 

5518 

5539 

5560 

5581 

5602 

5623 

5644 

5665 

5686 

2 4 6 8 11 

4.8 

5686 

5707 

5728 

5748 

5769 

5790 

5810 

5831 

5851 

5872 

5892 

2 4 6 8 10 

4.9 

5892 

5913 

5933 

5953 

5974 

5994 

6014 

6034 

6054 

6074 

1.6094 

2 4 6 8 10 
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TABLE X 


Log c (Base 


0 1 2 3 4 5 


5.0 

1.6094 

6114 6134 6154 6174 

6194 

5.1 

6292 

6312 6332 63S1 6371 

6390 

5.2 

6487 

6506 6525 6544 6563 

6582 

5.3 

6677 

6696 671S 6734 6752 

6771 

5.4 

6864 

6882 6901 6919 6938 

6956 

S.S 

7047 

7066 7084 7102 7120 

7138 

5.6 

7228 

7246 7263 7281 7299 

7317 

5.7 

7405 

7422 7440 7457 7475 

7492 

5.8 

7S79 

7596 7613 7630 7647 

7664 

S.9 

7750 

7766 7783 7800 7817 

7834 

c.o 

1.7918 

7934 7951 7967 7984 

8001 

6.1 

8083 

8099 8116 8132 8148 

8165 

6.2 

824S 

8262 8278 8294 8310 

8326 

6.3 

8405 

8421 8437 8453 8469 

848S 

6.4 

8S63 

8579 8594 8610 8625 

8641 

6.5 

8718 

8733 8749 8764 8779 

8795 

6.6 

8871 

8886 8901 8916 8931 

8946 

6.7 

9021 

9036 9051 9066 9081 

909 S 

6.8 

9169 

9184 9199 9213 9228 

9242 

6.9 

931S 

9330 9344 9359 9373 

9387 

7.0 

1.9459 

9473 9488 9502 9516 

9530 

7.1 

9601 

9615 9629 9643 9657 

9671 

7.2 

9741 

9755 9769 9782 9796 

9810 

7.3 

1.9879 

9892 9906 9920 9933 

9947 

7.4 

2.0015 

0028 0042 0055 0069 

0082 

7.5 

0149 

0162 0176 0189 0202 

0215 

7.6 

0281 

0295 0308 0321 0334 

0347 

7.7 

0412 

0425 0438 0451 0464 

0477 

7.8 

0S41 

0554 0567 0S80 0592 

0605 

7.9 

0669 

0681 0694 0707 0719 
• 

0732 

8.0 

2.0794 

0807 0819 0832 0844 

0857 

8.1 

0919 

0931 0943 0956 0968 

0980 

8.2 

1041 

1054 1066 1078 1090 

1102 

8.3 

1163 

117S 1187 1199 1211 

1223 

8.4 

1282 

1294 1306 1318 1330 

1342 

8.5 

• 1401 

1412 1424 1436 1448 

1459 

8.6 

1S18 

1529 1541 1552 1564 

1576 

8.7 

1633 

1645 1656 1668 1679 

1691 

8.8 

1748 

1759 1770 1782 1793 

1804 

8.9 

1861 

1872 1883 1894 190S 

1917 

9.0 

2.1972 

1983 1994 2006 2017 

2028 

9.1 

2083 

2094 2105 2116 2127 

2138 

9.2 

2192 

2203 2214 2225 2235 

2246 

9.3 

2300 

2311 2322 2332 2343 

2354 

9.4 

2407 

2418 2428 2439 2450 

2460 

9.5 

2513 

2S23 2534 2544 2555 

2S65 

9.6 

2618 

2628 2638 2649 2659 

2670 

9.7 

2721 

2732 2742 27S2 2762 

2773 

9.8 

2824 

2834 2844 2854 2865 

2875 

9.9 

2925 

2935 2946 2956 2966 

2976 


= 2.718284) 


6 

7 

8 

9 

10 

Tenths of the 
Tabular Difference 

1 2 3 4 5 

6214 

6233 

62 S3 

6273 

6292 

2 

4 

6 

8 10 

6409 

6429 

6448 

6467 

6487 

2 

4 

6 

8 10 

6601 

6620 

6639 

6658 

6677 

2 

4 

6 

8 10 

6790 

6808 

6827 

6845 

6864 

2 

4 

6 

7 

9 

6974 

6993 

7011 

7029 

7047 

2 

4 

6 

7 

9 

7156 

7174 

7192 

7210 

7228 

2 

4 

5 

7 

9 

7334 

73S2 

7370 

7387 

740S 

2 

4 

5 

7 

9 

7509 

7527 

7544 

7561 

7S79 

2 

3 

5 

7 

9 

7681 

7699 

7716 

7733 

77S0 

2 

3 

5 

7 

9 

7851 

7867 

7884 

7901 

1.7918 

2 

3 

5 

7 

8 

8017 

8034 

8050 

8066 

8083 

2 

3 

5 

7 

8 

8181 

8197 

8213 

8229 

824S 

2 

3 

5 

7 

8 

8342 

8358 

8374 

8390 

8405 

2 

3 

5 

6 

8 

8500 

8516 

8S32 

8547 

8563 

2 

3 

5 

6 

8 

8656 

8672 

8687 

8703 

8718 

2 

3 

S 

6 

8 

8810 

882S 

8840 

88 S6 

8871 

2 

3 

5 

6 

8 

8961 

8976 

8991 

9006 

9021 

2 

3 

5 

6 

8 

9110 

9125 

9140 

9155 

91C9 

1 

3 

4 

6 

7 

9257 

9272 

9286 

9301 

9315 

1 

3 

4 

6 

7 

9402 

9416 

9430 

9445 

1.9459 

1 

3 

4 

6 

7 

9544 

9559 

9573 

9587 

9601 

1 

3 

4 

6 

7 

9685 

9699 

9713 

9727 

9741 

1 

3 

4 

6 

7 

9824 

9838 

98S1 

986S 

1.9879 

1 

3 

4 

6 

7 

9961 

9974 

9988/0001 

2.0015 

1 

3 

4 

S 

7 

0096 

0109 

0122 

0136 

0149 

1 

3 

4 

5 

7 

0229 

0242 

0255 

0268 

0281 

1 

3 

4 

5 

7 

0360 

0373 

0386 

0399 

0412 

1 

3 

4 

5 

7 

0490 

0503 

0516 

0528 

0541 

1 

3 

4 

S 

6 

0618 

0631 

0643 

0656 

0669 

1 

3 

4 

5 

6 

0744 

0757 

0769 

0782 

2.0794 

1 

3 

4 

5 

6 

0869 

0882 

0894 

0906 

0919 

1 

2 

4 

S 

6 

0992 

1005 

1017 

1029 

1041 

1 

2 

4 

5 

6 

1114 

1126 

1138 

1150 

1163 

1 

2 

4 

S 

6 

1235 

1247 

1258 

1270 

1282 

1 

2 

4 

S 

6 

1353 

1365 

1377 

1389 

1401 

1 

2 

4 

5 

6 

1471 

1483 

1494 

1506 

1518 

1 

2 

4 

5 

6 

1587 

1599 

1610 

1622 

1633 

1 

2 

3 

5 

6 

1702 

1713 

1725 

1736 

1748 

1 

2 

3 

5 

6 

181S 

1827 

1838 

1849 

1861 

1 

2 

3 

5 

6 

1928 

1939 

1950 

1961 

2.1972 

1 

2 

3 

4 

6 

2039 

2050 

2061 

2072 

2083 

1 

2 

3 

4 

6 

2148 

2159 

2170 

2181 

2192 

1 

2 

3 

4 

5 

2257 

2268 

2279 

2289 

2300 

1 

2 

3 

4 

5 

2364 

2375 

2386 

2396 

2407 

1 

2 

3 

4 

5 

2471 

2481 

2492 

2502 

2513 

1 

2 

3 

4 

s 

2576 

2586 

2597 

2607 

2618 

1 

2 

3 

4 

s 

2680 

2690 

2701 

2711 

2721 

1 

2 

3 

4 

s 

2783 

2793 

2803 

2814 

2824 

1 

2 

3 

4 

5 

2885 

2895 

2905 

2915 

292 S 

1 

2 

3 

4 

5 

2986 

2996 

3006 

3016 

2.3026 

1 

2 

3 

4 

5 
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APPENDIX 2 


TABLE XI 

Logarithms to the Base 10 



0 

1 

2 

3 

4r 

5 

G 

7 

8 

9 

10 

1.00 

0.0000 

0004 

0009 

' 0013 

0017 

0022 

0026 

0030 

0035 

0039 

0043 

1.01 

0043 

0048 

0052 

0056 

i 0060 

0065 

0069 

' 0073 

0077 

0082 

0086 

1.02 

0086 

0090 

0095 

0099 

0103 

0107 

0111 

0116 

0120 

0124 

0128 

1.03 

0128 

0133 

0137 

0141 

0145 

0149 

0154 

0158 

0162 

0166 

0170 

1.04 

0170 

017S 

0179 

0183 

0187 

0191 

0195 

0199 

0204 

0208 

0212 

1.05 

0212 

0216 

0220 

0224 

0228 

0233 

0237 

0241 

024 S 

0249 

02 S3 

1.06 

0253 

0257 

0261 

0265 

0269 

0273 

0278 

0282 

0286 

0290 

0294 

1.07 

0294 

0298 

0302 

0306 

0310 

0314 

0318 

0322 

0326 

0330 

0334 

1.08 

0334 

0338 

0342 

0346 

03 SO 

03S4 

0358 

0362 

0366 

0370 

0374 

1.09 

0374 

0378 

0382 

0386 

0390 

0394 

0398 

0402 

0406 

0410 

0414 

1.10 

0.0414 

0418 

0422 

0426 

0430 

0434 

0438 

0441 

0445 

0449 

0453 

1.11 

04S3 

04 S7 

0461 

0465 

0469 

0473 

0477 

0481 

0484 

0488 

0492 

1.12 

0492 

0496 

0500 

0504 

0508 

0512 

0515 

0519 

0523 

0S27 

0531 

1.13 

0531 

053S 

0S38 

0S42 

0546 

0550 

0554 

05S8 

0561 

0565 

0569 

1.14 

0569 

0573 

0577 

0580 

0584 

0588 

0592 

0596 

0S99 

0603 

0607 

1.1S 

0607 

0611 

0615 

0618 

0622 

0626 

0630 

0633 

0637 

0641 

064S 

1.16 

064 S 

0648 

0652 

0656 

0660 

0663 

0667 

0671 

0674 

0678 

0682 

1.17 

0682 

0686 

0689 

0693 

0697 

0700 

0704 

0708 

0711 

0715 

0719 

1.18 

0719 

0722 

0726 

0730 

0734 

0737 

0741 

074 S 

0748 

0752 

0755 

1.19 

0755 

0759 

0763 

0766 

0770 

0774 

0777 

0781 

0785 

0788 

0792 

1.20 

0.0792 

0795 

0799 

0803 

0806 

0810 

0813 

0817 

0821 

0824 

0828 

1.21 

0828 

0831 

083S 

0839 

0842 

0846 

0849 

0853 

0856 

0860 

0864 

1.22 

0864 

0867 

0871 

0874 

0878 

0881 

0885 

0888 

0892 

0896 

0899 

1.23 

0899 

0903 

0906 

0910 

0913 

0917 

0920 

0924 

0927 

0931 

0934 

1.24 

0934 

0938 

0941 

0945 

0948 

0952 

0955 

0959 

0962 

0966 

0969 

1.25 

0969 

0973 

0976 

0980 

0983 

0986 

0990 

0993 

0997 

1000 

1004 

1.26 

1004 

1007 

1011 

1014 

1017 

1021 

1024 

1028 

1031 

1035 

1038 

1.27 

1038 

1041 

1045 

1048 

1052 

1055 

1059 

1062 

1065 

1069 

1072 

1.28 

1072 

107S 

1079 

1082 

1086 

1089 

1092 

1096 

1099 

1103 

1106 

1.29 

1106 

1109 

1113 

1116 

1119 

1123 

1126 

1129 

1133 

1136 

1139 

1.30 

0.1139 

1143 

1146 

1149 

1153 

1156 

1159 

1163 

1166 

1169 

1173 

1.31 

1173 

1176 

1179 

1183 

1186 

1189 

1193 

1196 

1199 

1202 

1206 

1.32 

1206 

1209 

1212 

1216 

1219 

1222 

1225 

1229 

1232 

1235 

1239 

1.33 

1239 

1242 

1245 

1248 

1252 

1255 

1258 

1261 

1265 

1268 

1271 

1.34 

1271 

1274 

1278 

1281 

1284 

1287 

1290 

1294 

1297 

1300 

1303 

1.3S 

1303 

1307 

1310 

1313 

1316 

1319 

1323 

1326 

1329 

1332 

1335 

1.36 

1335 

1339 

1342 

1345 

1348 

1351 

1355 

1358 

1361 

1364 

1367 

1.37 

1367 

1370 

1374 

1377 

1380 

1383 

1386 

1389 

1392 

1396 

1399 

1.38 

1399 

1402 

1405 

1408 

1411 

1414 

1413 

1421 

1424 

1427 

1430 

1.39 

1430 

1433 

1436 

1440 

1443 

1446 

1449 

1452 

1455 

1458 

1461 

1.40 

0.1461 

1464 

1467 

1471 

1474 

1477 

1480 

1483 

1486 

1489 

1492 

1.41 

1492 

1495 

1498 

1501 

1504 

1508 

1511 

1514 

1517 

1520 

1523 

1.42 

1523 

1526 

1529 

1532 

1535 

1538 

1541 

1544 

1547 

1550 

1553 

1.43 

1553 

1556 

1559 

1S62 

1565 

1569 

1572 

1575 

1578 

1581 

1584 

1.44 

1584 

1587 

1590 

1593 

1596 

1 599 

1602 

1605 

1608 

1611 

1614 

1.45 

1614 

1617 

1620 

1623 

1626 

1629 

1632 

1635 

1633 

1641 

1644 

1.46 

1644 

1647 

1649 

16S2 

165S 

1658 

1661 

1664 

1667 

1670 

1673 

1.47 

1673 

1676 

1679 

1682 

1685 

1688 

1691 

1694 

1697 

1700 

1703 

1.48 

1703 

1706 

1708 

1711 

1714 

1717 

1720 

1723 

1726 

1729 

1732 

1.49 

1732 

1735 

1738 

1741 

1744 

1746 

1749 

1752 

1755 

1758 

1761 
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TABLE XI 

Logarithms to the Base 10 



0 

1 

2 

3 

4 

1.50 

0.1761 

1764 

1767 

1770 

1772 

l.Sl 

1790 

1793 

1796 

1798 

1801 

1.52 

1818 

1821 

1824 

1827 

1830 

1.53 

1847 

1850 

1853 

1855 

1858 

1.S4 

1875 

1878 

1881 

1884 

1886 

1.55 

1903 

1906 

1909 

1912 

1915 

1.56 

1931 

1934 

1937 

1940 

1942 

1.57 

1959 

1962 

1965 

1967 

1970 

1.58 

1987 

1989 

1992 

199S 

1998 

1.59 

2014 

2017 

2019 

2022 

2025 

1.60 

0.2041 

2044 

2047 

2049 

2052 

1.61 

2068 

2071 

2074 

2076 

2079 

1.62 

2095 

2098 

2101 

2103 

2106 

1.63 

2122 

2125 

2127 

2130 

2133 

1.64 

2148 

2151 

2154 

2156 

21S9 

1 .6S 

2175 

2177 

2180 

2183 

2185 

1.66 

2201 

2204 

2206 

2209 

2212 

1.67 

2227 

2230 

2232 

2235 

2238 

1.68 

2253 

2256 

2258 

2261 

2263 

1.69 

2279 

2281 

2284 

2287 

2289 

1.70 

0.2304 

2307 

2310 

2312 

2315 

1.71 

2330 

2333 

2335 

2338 

2340 

1.72 

2355 

2358 

2360 

2363 

2365 

1.73 

2380 

2383 

2385 

2388 

2390 

1.74 

2405 

2408 

2410 

2413 

2415 

1.75 

2430 

2433 

2435 

2438 

2440 

1.76 

2455 

24S8 

2460 

2463 

2465 

1.77 

2480 

2482 

248S 

2487 

2490 

1.78 

2504 

2507 

2509 

2 S12 

2514 

1.79 

2529 

2531 

2533 

2536 

2538 

1.80 

0.2553 

2555 

25S8 

2560 

2562 

1.81 

2577 

2579 

2582 

2584 

2586 

1.82 

2601 

2603 

2605 

2608 

2610 

1.83 

2625 

2627 

2629 

2632 

2634 

1.84 

2648 

2651 

2653 

2655 

2658 

1.85 

2672 

2674 

2676 

2679 

2681 

1.86 

2695 

2697 

2700 

2702 

2704 

1.87 

2718 

2721 

2723 

2725 

2728 

1.88 

2742 

2744 

2746 

2749 

2751 

1.89 

2765 

2767 

2769 

2772 

2774 

1.90 

0.2788 

2790 

2792 

2794 

2797 

1.91 

2810 

2813 

281S 

2817 

2819 

1.92 

2833 

2835 

2838 

2840 

2842 

1.93 

2856 

2858 

2860 

2862 

2865 

1.94 

2878 

2880 

2882 

2885 

2887 

1.9S 

2900 

2903 

2905 

2907 

2909 

1.96 

2923 

2925 

2927 

2929 

2931 

1.97 

294S 

2947 

2949 

2951 

2953 

1.98 

2967 

2969 

2971 

2973 

2975 

1.99 

2989 

2991 

2993 

2995 

2997 


5 

6 

7 

8 

9 

10 

1775 

1778 

1781 

1784 

1787 

1790 

1804 

1807 

1810 

1813 

1816 

1818 

1833 

1836 

1838 

1841 

1844 

1847 

1861 

1864 

1867 

1870 

1872 

1875 

1889 

1892 

1895 

1898 

1901 

1903 

1917 

1920 

1923 

1926 

1928 

1931 

1945 

1948 

1951 

19S3 

1956 

1959 

1973 

1976 

1978 

1981 

198* 

1987 

2000 

2003 

2006 

2009 

2011 

2014 

2028 

2030 

2033 

2036 

2038 

2041 

2055 

2057 

2060 

2063 

2066 

2068 

2082 

2084 

2087 

2090 

2092 

2095 

2109 

2111 

2114 

2117 

2119 

2122 

2135 

2138 

2140 

2143 

2146 

2148 

2162 

2164 

2167 

2170 

2172 

217S 

2188 

2191 

2193 

2196 

2198 

2201 

2214 

2217 

2219 

2222 

2225 

2227 

2240 

2243 

2245 

2248 

2251 

2253 

2266 

2269 

2271 

2274 

2276 

2279 

2292 

2294 

2297 

2299 

2302 

2304 

2317 

2320 

2322 

2325 

2327 

2330 

2343 

2345 

2348 

2350 

23S3 

2355 

2368 

2370 

2373 

2375 

2378 

2380 

2393 

2395 

2398 

2400 

2403 

240S 

2418 

2420 

2423 

2425 

2428 

2430 

2443 

2445 

2448 

24S0 

24S3 

245S 

2467 

2470 

2472 

247S 

2477 

2480 

2492 

2494 

2497 

2499 

2502 

2504 

2516 

2519 

2521 

2524 

2526 

2529 

2541 

2543 

2545 

2548 

2 SS0 

2S53 

2565 

2567 

2570 

2572 

2574 

2577 

2589 

2S91 

2594 

2596 

2598 

2601 

2613 

26\S 

2617 

2620 

2622 

2625 

2636 

2639 

2641 

2643 

2646 

2648 

2660 

2662 

2665 

2667 

2669 

2672 

2683 

2686 

2688 

2690 

2693 

2695 

2707 

2709 

2711 

2714 

2716 

2718 

2730 

2732 

2735 

2737 

2739 

2742 

2753 

2755 

2758 

2760 

2762 

276S 

2776 

2778 

2781 

2783 

2785 

2788 

2799 

2801 

2804 

2806 

2808 

2810 

2822 

2824 

2826 

2828 

2831 

2833 

2844 

2847 

2849 

2851 

2853 

2856 

2867 

2869 

2871 

2874 

2876 

2878 

2889 

2891 

2894 

2896 

2898 

2900 

2911 

2914 

2916 

2918 

2920 

2923 

2934 

2936 

2938 

2940 

2942 

2945 

29S6 

29S8 

2960 

2962 

2964 

2967 

2978 

2980 

2982 

2984 

2986 

2989 

2999 

3002 

3004 

3006 

3008 

3010 
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APPENDIX 2 


TABLE XI 

Logarithms to the Base 10 

These two pages give the common logarithms of numbers between 1 and 10, correct to four places. 
Moving the decimal point n places to the right (or left) in the number is equivalent to adding n (or 
— n) to the logarithm. Thus, log 0.0174S3 - 0.2419 - 2 |» 2.2419). 

To facilitate interpolation, the tenths of the tabular differences are given at the end of each line, 
eo that the differences themselves need not be considered. In using these aids, first find the nearest 
tabular entry, and then add (to move to the right) or subtract (to move to the left), as the case may 
require. 


Tenths ol the 



0 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

Tabular Difference 
1 2 3 4 5 

1.0 

0.0000 

0043 

0086 

0128 

0170 

0212 

0253 

0294 

0334 

0374 

0414 


1.1 

0414 

0453 

0492 

0531 

0569 

0607 

0645 

0682 

0719 

07S5 

0792 


1.2 

0792 

0828 

0864 

0899 

0934 

0969 

1004 

1038 

1072 

1106 

1139 


1.3 

1139 

1173 

1206 

1239 

1271 

1303 

1335 

1367 

1399 

1430 

1461 

To avoid Interpo¬ 

1.4 

1461 

1492 

1523 

1553 

1584 

1614 

1644 

1673 

1703 

1732 

1761 

lation in the first 

l.S 

1761 

1790 

1818 

1847 

1875 

1903 

1931 

1959 

1987 

2014 

2041 

ten lines, use the 
special table on the 

1.6 

2041 

2068 

2095 

2122 

2148 

2175 

2201 

2227 

2253 

2279 

2304 

preceding page. 

1.7 

2304 

2330 

2355 

2380 

2405 

2430 

2455 

2480 

2504 

2529 

2553 


1.8 

2553 

2577 

2601 

2625 

2648 

2672 

2695 

2718 

2742 

276S 

2788 


1.9 

2788 

2810 

2833 

2856 

2878 

2900 

2923 

2945 

2967 

2989 

3010 


2.0 

0.3010 

3032 

3054 

3075 

3096 

3118 

3139 

3160 

3181 

3201 

3222 

2 4 6 8 11 

2.1 

3222 

3243 

3263 

3284 

3304 

3324 

334S 

3365 

3385 

3404 

3424 

2 4 6 8 10 

2.2 

3424 

3444 

3464 

3483 

3502 

3522 

3541 

3S60 

3579 

3598 

3617 

2 4 6 8 10 

2.3 

3617 

3636 

3655 

3674 

3692 

3711 

3729 

3747 

3766 

3784 

3802 

2 4 5 7 9 

2.4 

3802 

3820 

3838 

3856 

3874 

3892 

3909 

3927 

3945 

3962 

3979 

2 4 5 7 9 

2 .S 

3979 

3997 

4014 

4031 

4048 

4065 

4082 

4099 

4116 

4133 

4150 

2 3 5 7 9 

2.6 

41 SO 

4166 

4183 

4200 

4216 

4232 

4249 

4265 

4281 

4298 

4314 

2 3 5 7 8 

2.7 

4314 

4330 

4346 

4362 

4378 

4393 

4409 

4425 

4440 

4456 

4472 

2 3 5 6 8 

2.8 

4472 

4487 

4502 

4518 

4533 

4548 

4564 

4579 

4594 

4609 

4624 

2 3 5 6 8 

2.9 

4624 

4639 

4654 

4669 

4683 

4698 

4713 

4728 

4742 

4757 

4771 

1 3 4 6 7 

3.0 

0.4771 

4786 

4800 

4814 

4829 

4843 

4857 

4871 

4886 

4900 

4914 

1 3 4 6 7 

3.1 

4914 

4928 

4942 

4955 

4969 

4983 

4997 

5011 

5024 

5038 

5051 

1 3 4 6 7 

3.2 

5051 

S06S 

5079 

5092 

5105 

5119 

5132 

5145 

5159 

5172 

5185 

1 3 4 S 7 

3.3 

5185 

5198 

5211 

5224 

5237 

5250 

5263 

5276 

5289 

5302 

5315 

1 3 4 5 6 

3.4 

531S 

5328 

5340 

S353 

5366 

5378 

5391 

5403 

5416 

5428 

5441 

1 3 4 5 6 

3.5 

5441 

5453 

S465 

S478 

5490 

5502 

5514 

5527 

5539 

5551 

5563 

1 2 4 5 6 

3.6 

5S63 

5575 

5587 

5599 

5611 

5623 

5635 

5647 

5658 

5670 

5682 

1 2 4 5 6 

3.7 

5682 

5694 

5705 

5717 

5729 

5740 

5752 

5763 

5775 

5786 

5798 

1 2 3 5 6 

3.8 

5798 

5809 

5821 

5832 

5843 

5855 

5866 

5877 

5888 

5899 

5911 

1 2 3 5 6 

3.9 

5911 

5922 

5933 

5944 

5955 

5966 

5977 

5988 

5999 

6010 

6021 

1 2 3 4 6 

4.0 

0.6021 

6031 

6042 

6053 

6064 

6075 

6085 

6096 

6107 

6117 

6128 

1 2 3 4 5 

4.1 

6138 

6138 

6149 

6160 

6170 

6180 

6191 

6201 

6212 

6222 

6232 

1 2 3 4 5 

4.2 

6232 

6243 

6253 

6263 

6274 

6284 

6294 

6304 

6314 

6325 

6335 

1 2 3 4 5 

4.3 

633S 

634S 

6355 

6365 

6375 

638S 

6395 

6405 

6415 

6425 

6435 

1 2 3 4 S 

4.4 

6435 

6444 

6454 

6464 

6474 

6484 

6493 

6503 

6513 

6522 

6532 

1 2 3 4 S 

4.5 

6532 

6542 

6551 

6561 

6571 

6580 

6590 

6599 

6609 

6618 

6628 

1 2 3 4 S 

4.6 

6628 

6637 

6646 

6656 

6665 

667S 

6684 

6693 

6702 

6712 

6721 

1 2 3 4 5 

4.7 

6721 

6730 

6739 

6749 

6758 

6767 

6776 

6785 

6794 

6803 

6812 

1 2 3 4 5 

4 8 

6812 

6821 

6830 

6839 

6848 

6857 

6866 

6875 

6884 

6893 

6902 

1 2 3 4 4 

4.9 

6902 

6911 

6920 

6928 

6937 

6946 

6955 

6964 

6972 

6981 

6990 

1 2 3 4 4 
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TABLE XI 

Logarithms to the Base 10 


Tenths of the 


5.0 

0 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

Tabular Difference 
1 2 3 4 5 

0.6990 

6998 

7007 

7016 

7024 

7033 

7042 

7050 

7059 

7067 

7076 

1 

2 

3 

3 

4 

5.1 

7076 

7084 

7093 

7101 

7110 

7118 

7126 

7135 

7143 

71S2 

7160 

1 

2 

3 

3 

4 

5.2 

7160 

7168 

7177 

7185 

7193 

7202 

7210 

7218 

7226 

7235 

7243 

1 

2 

2 

3 

4 

5.3 

7243 

7251 

7259 

7267 

7275 

7284 

7292 

7300 

7308 

7316 

7324 

1 

2 

2 

3 

4 

5.4 

7324 

7332 

7340 

7348 

7356 

7364 

7372 

7380 

7388 

7396 

7404 

1 

2 

2 

3 

4 

5.5 

7404 

7412 

7419 

7427 

7435 

7443 

7451 

7459 

7466 

7474 

7482 

1 

2 

2 

3 

4 

5.6 

7482 

7490 

7497 

7505 

7513 

7520 

7528 

7536 

7543 

7551 

7559 

1 

2 

2 

3 

4 

5.7 

7559 

7566 

7574 

7582 

7589 

7597 

7604 

7612 

7619 

7627 

7634 

1 

2 

2 

3 

4 

5.8 

7634 

7642 

7649 

7657 

7664 

7672 

7679 

7686 

7694 

7701 

7709 

1 

1 

2 

3 

4 

5.9 

7709 

7716 

7723 

7731 

7738 

7745 

7752 

7760 

7767 

7774 

7782 

1 

1 

2 

3 

4 

6.0 

0.7782 

7789 

7796 

7803 

7810 

7818 

7825 

7832 

7839 

7846 

78S3 

1 

1 

2 

3 

4 

6.1 

7853 

7860 

7868 

7875 

7882 

7889 

7896 

7903 

7910 

7917 

7924 

1 

1 

2 

3 

4 

6.2 

7924 

7931 

7938 

7945 

7952 

7959 

7966 

7973 

7980 

7987 

7993 

1 

1 

2 

3 

3 

6.3 

7993 

8000 

8007 

8014 

8021 

8028 

8035 

8041 

8048 

8055 

8062 

1 

1 

2 

3 

3 

6.4 

8062 

8069 

8075 

8082 

8089 

8096 

8102 

8109 

8116 

8122 

8129 

1 

1 

2 

3 

3 

6.5 

8129 

8136 

8142 

8149 

8156 

8162 

8169 

8176 

8182 

8189 

8195 

1 

1 

2 

3 

3 

6.6 

8195 

8202 

8209 

8215 

8222 

8228 

8235 

8241 

8248 

8254 

8261 

1 

1 

2 

3 

3 

6.7 

8261 

8267 

8274 

8280 

8287 

8293 

8299 

8306 

8312 

8319 

8325 

1 

1 

2 

3 

3 

6.8 

8325 

8331 

8338 

8344 

8351 

8357 

8363 

8370 

8376 

8382 

8388 

1 

1 

2 

3 

3 

6.9 

8388 

8395 

8401 

8407 

8414 

8420 

8426 

8432 

8439 

8445 

8451 

1 

1 

2 

3 

3 

7.0 

0.8451 

8457 

8463 

8470 

8476 

8482 

8488 

8494 

8500 

8506 

8513 

1 

1 

2 

2 

3 

7.1 

8513 

8519 

8525 

8531 

8S37 

8543 

8549 

8555 

8561 

8567 

8573 

1 

1 

2 

2 

3 

7.2 

8573 

8579 

8585 

8591 

8597 

8603 

8609 

8615 

8621 

8627 

8633 

1 

1 

2 

2 

3 

7.3 

8633 

8639 

8645 

8651 

8657 

8663 

8669 

8675 

8681 

8686 

8692 

1 

1 

2 

2 

3 

7.4 

8692 

8698 

8704 

8710 

8716 

8722 

8727 

8733 

8739 

874S 

8751 

1 

1 

2 

2 

3 

7.S 

8751 

87S6 

8762 

8768 

8774 

8779 

8785 

8791 

8797 

8802 

8808 

1 

1 

2 

2 

3 

7.6 

8808 

8814 

8820 

8825 

8831 

8837 

8842 

8848 

8854 

8859 

8865 

1 

1 

2 

2 

3 

7.7 

8865 

8871 

8876 

8882 

8887 

8893 

8899 

8904 

8910 

8915 

8921 

1 

1 

2 

2 

3 

7.8 

8921 

8927 

8932 

8938 

8943 

8949 

8954 

8960 

8965 

8971 

8976 

1 

1 

2 

2 

3 

7.9 

8976 

8982 

8987 

8993 

8998 

9004 

9009 

9015 

9020 

9025 

9031 

1 

1 

2 

2 

3 

8.0 

0.9031 

9036 

9042 

9047 

9053 

9058 

9063 

9069 

9074 

9079 

9085 

1 

1 

2 

2 

3 

8.1 

9085 

9090 

9096 

9101 

9106 

9U2 

9117 

9122 

9128 

9133 

9138 

1 

1 

2 

2 

3 

8.2 

9138 

9143 

9149 

9154 

9159 

9166 

9170 

9175 

9180 

9186 

9191 

1 

1 

2 

2 

3 

8.3 

9191 

9196 

9201 

9206 

9212 

9217 

9222 

9227 

9232 

9238 

9243 

1 

1 

2 

2 

3 

8.4 

9243 

9248 

9253 

9258 

9263 

9269 

9274 

9279 

9284 

9289 

9294 

1 

1 

2 

2 

3 

8.5 

9294 

9299 

9304 

9309 

9315 

9320 

9325 

9330 

933S 

9340 

9345 

1 

m 

1 

2 

2 

A 

3 

8.6 

9345 

9350 

9355 

9360 

9365 

9370 

9375 

9380 

9385 

9390 

9395 

1 

1 

m 

2 

2 

A 

3 

8.7 

8.8 

9395 

9445 

9400 

9450 

9405 

9455 

9410 

9460 

9415 

9465 

9420 

9469 

9425 

9474 

9430 

9479 

9435 

9484 

9440 

9489 

944S 

9494 

0 

0 

1 

1 

i 

i 

i 

2 

2 

2 

2 

8.9 

9494 

9499 

9504 

9509 

9513 

9518 

9523 

9528 

9533 

9538 

9542 

0 

1 

2 


9.0 

9.1 

0.9542 

9590 

9547 

9595 

9552 

9600 

9557 

9605 

9562 

9609 

9566 

9614 

9571 

9619 

9576 

9624 

9581 

9628 

9586 

9633 

9590 

9638 

0 

0 

1 

l 

i 

i 

i 

i 

i 

2 

2 

2 

2 

9.2 

9.3 

9.4 

9638 

9685 

9731 

9643 

9689 

9736 

9647 

9694 

9741 

9652 

9699 

9745 

9657 

9703 

9750 

9661 

9708 

9754 

9666 

9713 

9759 

9671 

9717 

9763 

9675 

9722 

9768 

9680 

9727 

9773 

9685 

9731 

9777 

0 

0 

0 

l 

l 

1 

2 

2 

2 

z 

2 

2 

9.5 

9.6 

9.7 

9.8 

9.9 

9777 

9823 

9868 

9912 

9956 

9782 

9827 

9872 

9917 

9961 

9786 

9832 

9877 

9921 

9965 

9791 

9836 

9881 

9926 

9969 

979S 

9841 

9886 

9930 

9974 

9800 

984S 

9890 

9934 

9978 

9805 

9850 

9894 

9939 

9983 

9809 

9854 

9899 

9943 

9987 

9814 

9859 

9903 

9948 

9991 

9818 

9863 

9908 

9952 

9996 

9823 

9868 

9912 

9956 

0 

0 

0 

0 

0 

1 

1 

l 

l 

1 

i 

i 

i 

i 

i 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 
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APPENDIX 2 


TABLE XII 

Square Roots of Numbers 


N 

0 

1 

2 

3 

4 

5 

6 

7 

8 

9 



1.000 

1.005 

1.010 

1.015 

1.020 

1.025 

1.030 

1.034 

1.039 

1.044 

5 

1 

1.049 

1.054 

1.058 

1.063 

1.068 

1.072 

1.077 

1.0S2 

1.086 

1.091 


2 

1.095 

1.100 

1.105 

1.109 

1.114 

1.118 

1.122 

1.127 

1.131 

1.136 

4 

3 

1.140 

1.145 

1.149 

1.153 

1.158 

1.162 

1.166 

1.170 

1.175 

1.179 


4 

1.183 

1.187 

1.192 

1.196 

1.200 

1.204 

1.208 

1.212 

1.217 

1.221 


1.6 

1.225 

1.229 

1.233 

1.237 

•1.241 

1.245 

1.249 

1.253 

1.257 

1.261 


6 

1.265 

1.269 

1.273 

1.277 

1.281 

1.285 

1.288 

1.292 

1.296 

1.300 


7 

1.304 

1.308 

1.311 

1.315 

1.319 

1.323 

1.327 

1.330 

1.334 

1.338 


8 

1.342 

1.345 

1.349 

1.353 

1.356 

1.360 

1.364 

1.367 

1.371 

1.375 


9 

1.378 

1.382 

1.386 

1.389 

1.393 

1.396 

1.400 

1.404 

1.407 

1.411 


2.0 

1.414 

1.418 

1.421 

1.425 

1.428 

1.432 

1.435 

1.439 

1.442 

1.446 


1 

1.449 

1.453 

1.456 

1.459 

1.463 

1.466 

1.470 

1.473 

1.476 

1.480 

3 

2 

1.483 

1.487 

1.490 

1.493 

1.497 

1.500 

1.503 

1.507 

1.510 

1.513 


3 

1.517 • 

1.520 

1.523 

1.526 

1.530 

1.533 

1.536 

1.539 

1.543 

1.546 


4 

1.549 

1.552 

1.556 

1.559 

1.562 

1.565 

1.568 

1.572 

1.575 

1.578 


2.5 

1.581 

1.584 

1.587 

1.591 

1.594 

1.597 

1.600 

1.603 

1.606 

1.609 


6 

1.612 

1.616 

1.619 

1.622 

1.625 

1.628 

1.631 

1.634 

1.637 

1.640 


7 

1.643 

1.646 

1.649 

1.652 

1.655 

1.658 

1.661 

1.664 

1.667 

1.670 


8 

1.673 

1.676 

1.679 

1.682 

1.685 

1.688 

1.691 

1.694 

1.697 

1.700 


9 

1.703 

1.706 

1.709 

1.712 

1.715 

1.718 

1.720 

1.723 

1.726 

1.729 


3.0 

1.732 

1.735 

1.738 

1.741 

1.744 

1.746 

1.749 

1.752 

1.755 

1.758 


1 

1.761 

1.764 

1.766 

1.769 

1.772 

1.775 

1.778 

1.780 

1.783 

1.786 


2 

1.789 

1.792 

1.794 

1.797 

1.800 

1.803 

1.806 

1.80S 

1.811 

1.814 


3 

1.817 

1.819 

1.822 

1.825 

1.828 

1.830 

1.833 

1.836 

1.838 

1.841 


4 

1.844 

1.847 

1.849 

1.852 

1.855 

1.857 

1 .S60 

1.863 

1.865 

1.868 


3.6 

1.871 

1.873 

1.876 

1.879 

1.881 

1.884 

1.8S7 

1.8S9 

1.892 

1.895 


6 

1.897 

1.900 

1.903 

1.905 

1.908 

1.910 

1.913 

1.916 

1.918 

1.921 


7 

1.924 

1.926 

1.929 

1.931 

1.934 

1.936 

1.939 

1.942 

1.944 

1.947 


8 

1.949 

1.952 

1.954 

1.957 

1.960 

1.962 

1.965 

1.967 

1.970 

1.972 


9 

1.975 

1.977 

1.980' 

1.982 

1.985 

1.987 

1.990 

1.992 

1.995 

1.997 



2.000 

2.002 

2.005 

2.007 

2.010 

2.012 

2.015 

2.017 

2.020 

2.022 


1 

2.025 

2.027 

2.030 

2.032 

2.035 

2.037 

2.040 

2.042 

2.045 

2.047 

2 

2 

2.049 

2.052 

2.054 

2.057 

2.059 

2.062 

2.064 

2.066 

2.069 

2.071 


3 

2.074 

2.076 

2.078 

2.081 

2.083 

2.0S6 

2.08S 

2.090 

2.093 

2.095 


4 

2.098 

2.100 

2.102 

2.105 

2.107 

2.110 

2.112 

2.114 

2.117 

2.119 


4.5 

2.121 

2.124 

2.126 

2.128 

2.131 

2.133 

2.135 

2.138 

2.140 

2.142 


6 

2.145 

2.147 

2.149 

2.152 

2.154 

2.156 

2.159 

2.161 

2.163 

2.166 


7 

2.168 

2.170 

2.173 

2.175 

2.177 

2.179 

2.1S2 

2.184 

2.186 

2.189 


8 

2.191 

2.193 

2.195 

2.198 

2.200 

2.202 

2.205 

2.207 

2.209 

2.211 


9 

2.214 

2.216 

2.218 

2.220 

2.223 

2.225 

2.227 

2.229 

2.232 

2.234 



\Ztt = 1.77245+ 1/vV = 0.50419 y/V/2 = 1.25331 y/c = 1.G4S72 


Explanation of Table of Square Roots 

This table gives the values of y/N for values of X from 1 to 100, correct to four figures. 
(Interpolated values may be in error by 1 in the fourth figure.) 

To find the square root of a number N outside the range from 1 to 100, divide the 
digits of the number into blocks of two (beginning with the decimal point), and note 
that moving the decimal point two places in N is equivalent to moving it one place in 
the square root of N. For example: 

+2/718 = 1.648; +27L8 = 16.48; +0.00027 IS = 0.01648; 

+27718 = 5.213; +27l8" = 52.13; +0.002718 = 0.05213. 
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TABLE XII 
Square Roots 


N 

0 

1 

2 

3 

4 

5 

6 

7 

8 

9 

5.0 

2.236 

2.238 

2.241 

2.243 

2.245 

2.247 

2.249 

2.252 

2.254 

2.256 

1 

2.258 

2.261 

2.263 

2.265 

2.267 

2.269 

2.272 

2.274 

2.276 

2.278 

2 

2.280 

2.283 

2.2S5 

2.287 

2.289 

2.291 

2.293 

2.296 

2.298 

2.300 

3 

2.302 

2.304 

2.307 

2.309 

2.311 

2.313 

2.315 

2.317 

2.319 

2.322 

4 

2.324 

2.326 

2.32S 

2.330 

2.332 

2.335 

2.337 

2.339 

2.341 

2.343 

5.5 

2.345 

2.347 

2.349 

2.352 

2.354 

2.356 

2.358 

2.360 

2.362 

2.364 

6 

2.366 

2.369 

2.371 

2.373 

2.375 

2.377 

2.379 

2.381 

2.383 

2.385 

7 

2.387 

2.390 

2.392 

2.394 

2.396 

2.398 

2.400 

2.402 

2.404 

2.406 

8 

2.408 

2.410 

2.412 

2.415 

2.417 

2.419 

2.421 

2.423 

2.425 

2.427 

9 

2.429 

2.431 

2.433 

2.435 

2.437 

2.439 

2.441 

2.443 

2.445 

2.447 

6.0 

2.449 

2.452 

2.454 

2.456 

2.458 

2.460 

2.462 

2.464 

2.466 

2.468 

1 

2.470 

2.472 

2.474 

2.476 

2.478 

2.480 

2.482 

2.484 

2.486 

2.488 

2 

2.490 

2.492 

2.494 

2.496 

2.498 

2.500 

2.502 

2.504 

2.506 

2.508 

3 

2.510 

2.512 

2.514 

2.516 

2.518 

2.520 

2.522 

2.524 

2.526 

2.528 

4 

2.530 

2.532 

2.534 

2.536 

2.53S 

2.540 

2.542 

2.544 

2.546 

2.548 

6.5 

2.550 

2.551 

2.553 

2.555 

2.557 

2.559 

2.561 

2.563 

2.565 

2.567 

6 

2.569 

2.571 

2.573 

2.575 

2.577 

2.579 

2.581 

2.583 

2.585 

2.587 

7 

2.588 

2.590 

2.592 

2.594 

2.596 

2.598 

2.600 

2.602 

2.604 

2.606 

8 

2.608 

2.610 

2.612 

2.613 

2.615 

2.617 

2.619 

2.621 

2.623 

2.625 

9 

2.627 

2.629 

2.631 

2.632 

2.634 

2.636 

2.638 

2.640 

2.642 

2.644 

7.0 

2.646 

2.648 

2.650 

2.651 

2.653 

2.655 

2.657 

2.659 

2.661 

2.663 

1 

2.665 

2.066 

2.668 

2.670 

2.672 

2.674 

2.676 

2.678 

2.680 

2.681 

2 

2.683 

2.685 

2.687 

2.6S9 

2.691 

2.693 

2.694 

2.696 

2.698 

2.700 

3 

2.702 

2.704 

2.706 

2.707 

2.709 

2.711 

2.713 

2.715 

2.717 

2.718 

4 

2.720 

2.722 

2.724 

2.726 

2.728 

2.729 

2.731 

2.733 

2.735 

2.737 

7.5 

2.739 

2.740 

2.742 

2.744 

2.746 

2.748 

2.750 

2.751 

2.753 

2.755 

6 

2.757 

2.759 

2.760 

2.762 

2.764 

2.766 

2.768 

2.769 

2.771 

2.773 

7 

2.775 

2.777 

2.778 

2.780 

2.782 

2.784 

2.786 

2.787 

2.789 

2.791 

8 

2.793 

2.795 

2.796 

2.798 

2.S00 

2.802 

2.804 

2.805 

2.807 

2.809 

9 

2.811 

2.812 

2.814 

2.S16 

2.818 

2.820 

2.821 

2.823 

2.825 

2.827 

8.0 

2.828 

2.830 

2.832 

2.834 

2.835 

2.837 

2.839 

2.841 

2.843 

2.844 

1 

2.846 

2.848 

2.850 

2.S51 

2.853 

2.S55 

2.857 

2.858 

2.860 

2.862 

2 

2.864 

2.865 

2.867 

2.869 

2.871 

2.872 

2.874 

2.876 

2.877 

2.879 

3 

2.881 

2.883 

2.8S4 

2.886 

2.8S8 

2.890 

2.891 

2.893 

2.895 

2.897 

4 

2.898 

2.900 

2.902 

2.903 

2.905 

2.907 

2.909 

2.910 

2.912 

2.914 

8.5 

2.915 

2.917 

2.919 

2.921 

2.922 

2.924 

2.926 

2.927 

2.929 

2.931 

6 

2.933 

2.934 

2.936 

2.938 

2.939 

2.941 

2.943 

2.944 

2.946 

2.948 

7 

2.950 

2.951 

2.953 

2.955 

2.956 

2.958 

2.960 

2.961 

2.963 

2.965 

8 

2.966 

2.968 

2.970 

2.972 

2.973 

2.975 

2.977 

2.978 

2.980 

2.982 

9 

2.983 

2.985 

2.987 

2.988 

2.990 

2.992 

2.993 

2.995 

2.997 

2.998 

9.0 

3.000 

3.002 

3.003 

3.005 

3.007 

3.008 

3.010 

3.012 

3.013 

3.015 

1 

3.017 

3.018 

3.020 

3.022 

3.023 

3.025 

3.027 

3.028 

3.030 

3.032 

2 

3.033 

3.035 

3.036 

3.038 

3.040 

3.041 

3.043 

3.045 

3.046 

3.048 

3 

3.050 

3.051 

3.053 

3.055 

3.056 

3.058 

3.059 

3.061 

3.063 

3.064 

4 

3.066 

3.068 

3.069 

3.071 

3.072 

3.074 

3.076 

3.077 

3.079 

3.081 

9.5 

3.082 

3.084 

3.085 

3.087 

3.089 

3.090 

3.092 

3.094 

3.095 

3.097 

6 

3.098 

3.100 

3.102 

3.103 

3.105 

3.106 

3.108 

3.110 

3.111 

3.113 

7 

3.114 

3.116 

3.118 

3.119 

3.121 

3.122 

3.124 

3.126 

3.127 

3.129 

8 

3.130 

3.132 

3.134 

3.135 

3.137 

3.138 

3.140 

3.142 

3.143 

3.145 

9 

3.146 

3.148 

3.150 

3.151 

3.153 

3.154 

3.156 

3.158 

3.159 

3.161 



2 


Moving the decimal point TWO places in ;V requires moving it ONE place in body 
of table. 
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APPENDIX 2 


TABLE XII 
Square Roots 


• • 


N 

0 

1 

2 

3 

4 

5 

6 

7 

8 

9 

W)ta 

10. 

3.162 

3.178 

3.194 

3.209 

3.225 

3.240 

3.256 

3.271 

3.286 

3.302 

16 

1. 

3.317 

3.332 

3.347 

3.362 

3.376 

3.391 

3.406 

3.421 

3.435 

3.450 

15 

2. 

3.4G4 

3.479 

3.493 

3.507 

3.521 

3.536 

3.550 

3.564 

3.578 

3.592 

14 

3. 

3.606 

3.619 

3.633 

3.647 

3.661 

3.674 

3.688 

3.701 

3.715 

3.728 

4. 

3.742 

3.755 

3.768 

3.782 

3.795 

3.808 

3.821 

3.834 

3.847 

3.860 

13 

15. 

3.873 

3.886 

3.899 

3.912 

3.924 

3.937 

3.950 

3.962 

3.975 

3.987 


6. 

4.000 

4.012 

4.025 

4.037 

4.050 

4.062 

4.074 

4.087 

4.099 

4.111 

12 

7. 

4.123 

4.135 

4.147 

4.159 

4.171 

4.183 

4.195 

4.207 

4.219 

4.231 

8. 

4.243 

4.254 

4.266 

4.278 

4.290 

4.301 

4.313 

4.324 

4.336 

4.347 


9. 

4.359 

4.370 

4.382 

4.393 

4.405 

4.416 

4.427 

4.438 

4.450 

4.461 

11 

20. 

4.472 

4.483 

4.494 

4.506 

4.517 

4.528 

4.539 

4.550 

4.561 

4.572 


1. 

4.583 

4.593 

4.604 

4.615 

4.626 

4.637 

4.648 

4.658 

4.669 

4.6S0 


2. 

4.690 

4.701 

4.712 

4.722 

4.733 

4.743 

4.754 

4.764 

4.775 

4.785 


3. 

4.796 

4.806 

4.817 

4.827 

4.837 

4.848 

4.858 

4.868 

4.879 

4.889 

10 

4. 

4.899 

4.909 

4.919 

4.930 

4.940 

4.950 

4.960 

4.970 

4.980 

4.990 

25. 

5.000 

5.010 

5.020 

5.030 

5.040 

5.050 

5.060 

5.070 

5.079 

5.089 


6. 

5.099 

5.109 

5.119 

5.128 

5.138 

5.148 

5.158 

5.167 

5.177 

5.187 


7. 

5.196 

5.206 

5.215 

5.225 

5.235 

5.244 

5.254 

5.263 

5.273 

5.282 


8. 

5.292 

5.301 

5.310 

5.320 

5.329 

5.339 

5.34S 

5.357 

5.367 

5.376 

9 

9. 

5.385 

5.394 

5.404 

5.413 

5.422 

5.431 

5.441 

5.450 

5.459 

5.468 


30. 

5.477 

5.486 

5.495 

5.505 

5.514 

5.523 

5.532 

5.541 

5.550 

5.559 


1. 

5.568 

5.577 

5.586 

5.595 

5.604 

5.612 

5.621 

5.630 

5.639 

5.648 


2. 

5.657 

5.666 

5.675 

5.683 

5.692 

5.701 

5.710 

5.718 

5.727 

5.736 


3. 

5.745 

5.753 

5.762 

5.771 

5.779 

5.788 

5.797 

5.805 

5.814 

5.822 


4. 

5.831 

5.840 

5.848 

5.857 

5.865 

5.874 

5.882 

5.891 

5.899 

5.908 

8 

35. 

5.916 

5.925 

5.933 

5.941 

5.950 

5.958 

5.967 

5.975 

5.983 

5.992 


6 . 

6.000 

6.008 

6.017 

6.025 

6.033 

6.042 

6.050 

6.058 

6.066 

6.075 


7. 

6.083 

6.091 

6.099 

6.107 

6.116 

6.124 

6.132 

6.140 

6.148 

6.156 


8. 

6.164 

6.173 

6.1S1 

6.189 

6.197 

6.205 

6.213 

6.221 

6.229 

6.237 


9. 

6.245 

6.253 

6.261 

6.269 

6.277 

6.2S5 

6.293 

6.301 

6.309 

6.317 


40. 

6.325 

6.332 

6.340 

6.348 

6.356 

6.364 

6.372 

6.380 

6.387 

6.395 


1. 

6.403 

6.411 

6.419 

6.427 

6.434 

6.442 

6.450 

6.458 

6.465 

6.473 


2. 

6.481 

6.488 

6.496 

6.504 

6.512 

6.519 

6.527 

6.535 

6.542 

6.550 


3. 

6.557 

6.565 

6.573 

6.580 

6.5S8 

6.595 

6.603 

6.611 

6.618 

6.626 


4. 

6.633 

6.641 

6.648 

6.656 

6.663 

6.671 

6.678 

6.686 

6.693 

6.701 


45. 

6.708 

6.716 

6.723 

6.731 

6.738 

6.745 

6.753 

6.760 

6.768 

6.775 


6 . 

6.782 

6.790 

6.797 

6.804 

6.812 

6.819 

6.826 

6.834 

6.841 

6.848 


7. 

6.856 

6.863 

6.870 

6.877 

6.885 

6.892 

6.899 

6.907 

6.914 

6.921 


8. 

6.928 

6.935 

6.943 

6.950 

6.957 

6.964 

6.971 

6.979 

6.986 

6.993 


9. 

7.000 

7.007 

7.014 

7.021 

7.029 

7.036 

7.043 

7.050 

7.057 

7.064 



I 


Square Roots of Certain Fractions 


N 

y/N 

N 

y/N 

N 

y/N 

N 

y/N 

N 

y/N 

N 

y/N 

Vi 

0.7071 

U 

0.7746 

Vi 

0.7559 

W 

0.3333 

m 

0.6455 

He 

0.7500 

Vi 

0.5774 

H 

0.8944 

H 

0.8452 

H 

0.4714 

Bxfl 

0.7638 

‘Ho 

0.8292 

Vi 

0.8165 

56 

0.4082 

H 

0.9258 

56 

0.6667 

‘Ha 

0.9574 

‘Ho 

0.9014 

M 

0.5000 

H 

0.9129 

H 

0.3536 

H 

0.7454 

Ho 

0.2500 

‘Ho 

0.9682 

H 

0.8660 

Vi 

0.3780 

H 

0.6124 

7 /6 

0.8819 

Ho 

0.4330 

Ha 

0.176S 

Vi 

0.4472 

V* 

0.5345 


0.7906 

96 

0.9428 

Ho 

0.5590 

H* 

0.1250 

n 

0.6325 

V 

0.6547 


0.9354 

H 2 

0.28S7 

Ho 

0.6614 

Ho 

0.1414 
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TABLE XII 


Square Roots 


N 

0 

1 

2 

3 

4 

5 

6 

7 

8 

9 

Avg. 

diff. 

50 . 

7.071 

7.078 

7.085 

7.092 

7.099 

7.106 

7.113 

7.120 

7.127 

7.134 

7 

1. 

7.141 

7.148 

7.155 

7.162 

7.169 

7.176 

7.183 

7.190 

7.197 

7.204 


2. 

7.211 

7.218 

7.225 

7.232 

7.239 

7.246 

7.253 

7.259 

7.266 

7.273 


3 . 

7.280 

7.287 

7.294 

7.301 

7.308 

7.314 

7.321 

7.328 

7.335 

7.342 


4. 

7.348 

7.355 

7.362 

7.369 

7.376 

7.382 

7.389 

7.396 

7.403 

7.409 


55 . 

7.416 

7.423 

7.430 

7.436 

7.443 

7.450 

7.457 

7.463 

7.470 

7.477 


6 . 

7.483 

7.490 

7.497 

7.503 

7.510 

7.517 

7.523 

7.530 

7.537 

7.543 


7. 

7.550 

7.556 

7.563 

7.570 

7.576 

7.583 

7.589 

7.596 

7.603 

7.609 


8. 

7.616 

7.622 

7.629 

7.635 

7.642 

7.649 

7.655 

7.662 

7.668 

7.675 


9. 

7.681 

7.688 

7.694 

7.701 

7.707 

7.714 

7.720 

7.727 

7.733 

7.740 

6 

60 . 

7.746 

7.752 

7.759 

7.765 

7.772 

7.778 

7.785 

7.791 

7.797 

7.S04 


1 . 

7.810 

7.817 

7.823 

7.829 

7.836 

7.842 

7.849 

7.855 

7.861 

7.868 


2. 

7.874 

7.880 

7.887 

7.893 

7.899 

7.906 

7.912 

7.918 

7.925 

7.931 


3. 

7.937 

7.944 

7.950 

7.956 

7.962 

7.969 

7.975 

7.981 

7.987 

7.994 


4. 

8.000 

8.006 

8.012 

8.019 

8.025 

8.031 

8.037 

S.044 

8.050 

8.056 


65 . 

8.062 

8.068 

8.075 

8.081 

8.087 

8.093 

8.099 

8.106 

8.112 

8.118 


6. 

8.124 

8.130 

8.136 

8.142 

8.149 

8.155 

8.161 

8.167 

8.173 

8.179 


7. 

8.185 

8.191 

8.198 

8.204 

8.210 

8.216 

8.222 

8.228 

8.234 

8.240 


8. 

8.246 

8.252 

8.258 

8.264 

8.270 

8.276 

S.283 

8.289 

8.295 

8.301 


9. 

8.307 

8.313 

8.319 

8.325 

8.331 

S.337 

8.343 

8.349 

8.355 

8.361 


70. 

8.367 

8.373 

8.379 

8.385 

8.390 

8.396 

8.402 

8.40S 

8.414 

S.420 


1 . 

8.426 

8.432 

8.438 

8.444 

8.450 

8.456 

8.462 

8.468 

8.473 

8.479 


2. 

8.485 

8.491 

8.497 

8.503 

8.509 

8.515 

8.521 

8.526 

8.532 

8.538 


3. 

8.544 

8.550 

8.556 

8.562 

8.567 

8.573 

8.579 

8.585 

8.591 

8.597 


4. 

8.602 

8.608 

S.614 

8.620 

8.626 

8.631 

8.637 

8.643 

8.649 

8.654 


75 . 

8.660 

8.666 

8.672 

8.678 

8.683 

8.689 

S.695 

8.701 

8.706 

8.712 


6. 

8.718 

8.724 

8.729 

8.735 

8.741 

S.746 

8.752 

8.758 

8.764 

8.769 


7. 

8.775 

8.781 

8.786 

8.792 

8.798 

8.803 

S.S09 

8.815 

8.820 

8.826 


8. 

8.832 

8.837 

8,843 

8.849 

8.854 

8.860 

8.866 

8.871 

8.877 

8.S83 


9. 

8.888 

8.894 

8.899 

8.905 

8.911 

8.916 

8.922 

8.927 

8.933 

8.939 


80. 

8.944 

8.950 

8.955 

8.961 

8.967 

8.972 

8.978 

8.983 

8.989 

8.994 


1 . 

9.000 

9.006 

9.011 

9.017 

9.022 

9.028 

9.033 

9.039 

9.044 

9.050 


2. 

9.055 

9.061 

9.066 

9.072 

9.077 

9.083 

9.088 

9.094 

9.099 

9.105 

5 

3. 

9.110 

9.116 

9.121 

9.127 

9.132 

9.138 

9.143 

9.149 

9.154 

9.160 


4. 

9.165 

9.171 

9.176 

9.182 

9.187 

9.192 

9.19S 

9.203 

9.209 

9.214 


85 . 

9.220 

9.225 

9.230 

9.236 

9.241 

9.247 

9.252 

9.257 

9.263 

9.268 


6. 

9.274 

9.279 

9.284 

9.290 

9.295 

9.301 

9.306 

9.311 

9.317 

9.322 


7. 

9.327 

9.333 

9.338 

9.343 

9.349 

9.354 

9.359 

9.365 

9.370 

9.3/0 


8. 

9.381 

9.386 

9.391 

9.397 

9.402 

9.407 

9.413 

9.4 IS 

9.423 

9.429 


9. 

9.434 

9.439 

9.445 

9.450 

9.455 

9.460 

9.466 

9.471 

9.476 

9.482 


90 . 

9.487 

9.492 

9.497 

9.503 

9.508 

9.513 

9.518 

9.524 

9.529 

9.534 


1 . 

9.539 

9.545 

9.550 

9.555 

9.560 

9.566 

9.571 

9.576 

9.581 

9.586 


2. 

9.592 

9.597 

9.602 

9.607 

9.612 

9.618 

9.623 

9.628 

9.633 

9.638 


3. 

9.644 

9.649 

9.654 

9.659 

9.664 

9.670 

9.675 

9.6S0 

9.685 

9.690 


4. 

9.695 

9.701 

9.706 

9.711 

9.716 

9.721 

9.726 

9.731 

9.737 

9.742 


95 . 

9.747 

9.752 

9.757 

9.762 

9.767 

9.772 

9.778 

9.783 

9.7S8 

9.793 


6. 

9.798 

9.803 

9.808 

9.813 

9.818 

9.823 

9.829 

9.834 

9.839 

9.844 


7. 

9.849 

9.854 

9.859 

9.864 

9.869 

9.874 

9.S79 

9.8S4 

9.889 

9.894 


8. 

9.899 

9.905 

9.910 

9.915 

9.920 

9.925 

9.930 

9.935 

9.940 

9.945 


9. 

9.950 

9.955 

9.960 

9.965 

9.970 

9.975 

9.980 

9.985 

9.990 

9.995 




1.77245+ 1/V5T= 

0.56419 

y/ 7r/2 

= 1.25331 

V'- = 1.64872 


Note. This table was taken, by permission, from Marks' Mechanical Engineers’ Handbook, published 
by McGraw-Hill Book Co. This arrangement was reproduced directly from Pierce s A bhort J able o) 
Integral*, published by Ginn & Co., with permission. 
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APPENDIX 2 


TABLE XIII 


Trigonometric Functions 


Radians 

Degrees 

Sines 

Cosines 

Tangents 

Cotangents 

5 


.0000 

0 

.0000 

1.0000 

.0000 

00 

90 

1.5708 


1 

.0175 

.9998 

.0175 

57.29 

89 

1.5533 


2 

.0349 

.9994 

.0349 

28.64 

88 

1.5359 

.0524 

A -v 

3 

.0523 

.9986 

.0524 

19.08 

87 

1.5184 

.0698 

4 

.0698 

.9976 

.0699 

14.30 

86 

1.5010 

.0873 

5 

.0872 

.9962 

.0875 

11.430 

85 

1.4835 

.1047 

6 

.1045 

.9945 

.1051 

9.514 

84 

1.4661 

.1222 

7 

.1219 

.9925 

.1228 

8.144 

83 

1.4486 

.1396 

8 

.1392 

.9903 

.1405 

7.115 

82 

1.4312 

. 1571 

9 

.1564 

.9877 

.1584 

6.314 

81 

1.4137 

.1745 

10 

.1736 

.9848 

.1763 

5.671 

80 

1.3963 

.1920 

11 

.1908 

.9816 

.1944 

5.145 

79 

1.3788 

.2094 

12 

.2079 

.9781 

.2126 

4.705 

78 

1.3614 

.2269 

13 

.2250 

.9744 

.2309 

4.332 

77 

1.3439 

.2443 

14 

.2419 

.9703 

.2493 

4.011 

76 

1.3265 

.2618 

15 

.2588 

.9659 

.2679 

3.732 

75 

1.3090 

.2793 

16 

.2756 

.9613 

.2867 

3.487 

74 

1.2915 

.2967 

17 

.2924 

.9563 

.3057 

3.271 

73 

1.2741 

.3142 

18 

.3090 

.9511 

. 3249 

3.078 

72 

1.2566 

.3316 

19 

.3256 

.9455 

.3443 

2.904 

71 

1.2392 

.3491 

20 

.3420 

.9397 

. 3640 

2.748 

70 

1.2217 

.3665 

21 

.3584 

.9336 

.3839 

2.605 

69 

1.2043 

.3840 

22 

.3746 

.9272 

.4040 

2.475 

68 

1.1868 

.4014 

23 

.3907 

. 9205 

.4245 

2.356 

67 

1.1694 

.4189 

24 

.4067 

.9135 

.4452 

2.246 

66 

1.1519 

.4363 

25 

.4226 

.9063 

.4663 

2.144 

65 

1.1345 

.4538 

26 

.4384 

.8988 

.4877 

2.050 

64 

1.1170 

.4712 

27 

.4540 

.8910 

.5095 

1.963 

63 

1.0996 

.4887 

28 

. 4695 

.8829 

.5317 

1.881 

62 

1.0821 

.5061 

29 

.4848 

.8746 

.5543 

1.804 

61 

1.0647 

.5236 

30 

.5000 

.8660 

.5774 

1.732 

60 

1.0472 

.5411 

31 

.5150 

.8572 

.6009 

1.664 

59 

1.0297 

.5585 

32 

. 5299 

.8480 

. 6249 

1.600 

58 

1.0123 

.5760 

33 

.5446 

.8387 

.6494 

1.540 

57 

0.9948 

.5934 

34 

.5592 

.8290 

.6745 

1.483 

56 

0.9774 

.6109 

35 

. 5736 

.8192 

. 7002 

1.428 

55 

0.9599 

.6283 

36 

.5878 

.8090 

. 7265 

1.376 

54 

0.9425 

.6458 

37 

.6018 

. 7986 

.7536 

1.327 

53 

0.9250 

. 6632 

38 

.6157 

.7880 

.7813 

1.280 

52 

0.9076 

.6807 

39 

.6293 

.7771 

.S098 

1.235 

51 

0.8901 

.6981 

40 

.6428 

. 7660 

.8391 

1.192 

50 

0.8727 

.7156 

41 

.6561 

.7547 

.8693 

1.150 

49 

0.8552 

.7330 

42 

.6691 

.7431 

.9004 

1.111 

48 

0.8378 

.7505 

43 

. 6820 

.7314 

. 9325 

1.072 

47 

0.8203 

.7679 

44 

. 6947 

.7193 

.9657 

1.036 

46 

0.8029 

.7854 

45 

.7071 

.7071 

1.0000 

1.000 

45 

0.7854 



Cosines 

Sines 1 

Cotangents 

Tangents 

Degrees 

Radians 
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Adjusted measurements, 216 
probable errors of, 229 
Adjustment of conditioned measurements, 
216 

normal equations for, 217 
of atomic physics constants, 230 
of nonlinearly related quantities, 222 
short method of, 226 

Arbitrary constants, evaluation of, see Eval¬ 
uating arbitrary constants 
probable errors of, 79, 249 
Areas, determination of, sec Integration 
Arithmetic means, inconsistent sets of, 197 
reasons for, 200 
tests for, 198 
grand mean of, 199 

of equally weighted measurements, 146, 
152, 161 

short method of computing, 168 
of unequally weighted measurements, 189 
short method of computing, 194 
A. S. T. M., 13 

Atomic physics, constants of, 230 
Average deviation, 157; see also Precision 
indexes 

Average ordinate method of integration, 101 
Averages method of finding equations, 72 

Baily, J. L., 252, 337 
Bearden, J. A., 203 
Beattie, James A., 203, 245 
Birge, R. T., 177, 186, 211, 232, 250, 252, 
337 

Birge-Bond diagram, 234 
Blanch, G. J., 96 
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Bond, W. N., 232, 337 
Brunt, David, 337 
Burgess, C. O., 40 
Byerly, W. E., 112 

Campbell, N., 73 
Chauvenet’s criterion, 170 
Chi-square test, 177, 182 
Chubb, L. W., 134 

harmonic analyzer, 134 
Clarke, F. W., 35 
Coefficient of alienation, 274, 279 
Coefficient of correlation, see Correlation 
coefficient 

Coefficient of determination, 274 
Coefficient of multiple correlation, 287 
Coefficient of partial correlation, 288 
Cohen, P., 34 
Column headings, 5, 14 
Columns in tables, 5 
Compton, A. H., 176 
Comstock, G. C., 337 


Conditioned measurements, adjustment of, 
see Adjustment of conditioned meas¬ 
urements 

Condon. E. U., 252, 337 
Consistency of a set of means, sec Arithmetic 
means, inconsistent sets of 
Constants, evaluation of, see Evaluating ar¬ 
bitrary constants 
of atomic physics, 230 
probable errors of, 79, 249 
Coordinate scales, choice of, 41 
labeling of, 47 
Corcoran, G. F„ 109, 124 
Correlation, 270 

and frequency distribution, 274 

index of, 287 

multiple, 287 

nonlinear, 286 

partial, 288 

Correlation coefficient, 273 
and regression lines, 284 
and the z-function, 281 
for grouped data, 276 
for multiple correlation, 2S7 
for partial correlation, 288 
graphical method for computing, 285 
limiting values of, 274 
physical interpretation of, 278 
precision indexes of, 281 
reliability of, 281 
Cox, G. C.. 252, 337 
Crumpler, T. B., 337 

Cut-and-weigh method of integration, 103 

Darwin, C. G., 232, 337 
Deming, W. E.. 197, 198, 337, 338 
Determinants, 309 
evaluation of, 310 

obtaining equations of curves by, 313 
simplification of, 312 
solution of simultaneous equations by, 
309 

Differences, tabular, 7, 15 
Differentiation, 85 

graphical methods of, 87 
mechanical devices for, 89, 91 
tabular methods of, 92 
Distributions, see Frequency distributions 
Dubois, E. F.. 47 
DuMond, J. W. M„ 232, 338 
Dunnington, F. G„ 204, 232, 338 

Empirical equations, 56 

choosing a suitable form for, 56 
testing the suitability of, 5S 
Equation method of interpolation, 18 
Equations, empirical, see Empirical equa¬ 
tions 

least-squares, see Least-squares equations 
normal, 217 
rational, 56 
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INDEX 


Equations, representation of data by, 56 
Errors, accidental, 152 
elementary, 149 

normal law of, see Normal frequency dis¬ 
tribution 
systematic, 152 

Evaluating arbitrary constants, 64 
least-squares method, 64, 77, 238 
method of averages, 72 
method of moments, 75 
selected-points method, 68, 77 
straight-line graph method, 64, 65 
successive approximation method, 76 
zero sum method, 73 
Evans, D. L. C., 91 
Experiments, planning of, 212 
Extrapolation, 24 

Federal Works Agency, 338 
Fisher, R. A., 281, 338 
z-function, 281 
Flatness, 182 
Forgeng, W. D., 40 
Forsythe, W. E., 27, 55, 83 
Fourier series, 107 

approximated by a finite series, 141 
coefficients of, 113, 115, 119 
convergence of, 112 

evaluation of coefficients, 114, 117, 124, 
130 

differentiability of, 112 
functions expressible by, 108 
integrability of, 112 
special cycles expressible by, 122 
types of, 110 

half-range cosine series, 111 
half-range sine series, 111 
whole-range sine-cosine series, 110 
Fourier's integral, 109, 112, 120 
Fowlc, F. E., 79 
Frequency coefficient, 157 
Frequency distributions, nonnormal, 174 
normal, see Normal frequency distribu¬ 
tion 

skewed, 171 

test for suitability of, 183 
tests for normality of, 177, 182 
Fry, Thornton O., 174, 1S4, 338 
Functional tables, 2, 6 

Galton’s quincunx, 153 

General Radio Co. harmonic analyzer, 140 

Geometric mean, 146 

Geometric slope, 87 

Ginnings, D. C\, 268 

Goodwin, A. M., 338 

Grand mean, 195 

of inconsistent means, 199 
Graph paper, choice of, 38 
logarithmic, 36 
polar, 36 

probability, 36, 177, 181 
rectangular, 36, 41 
semi-log, 36 
trilincar, 37 

Graphical method, of computing correlation 
coefficients, 285 
of differentiation, 87 
of evaluating constants, 64, 65 
of integration, 98 
of interpolation, 16 
of presenting data, 29 


Graphical method, of testing'the suitability 
of a rational equation, 58 
Graphs, advantages of, 29 
qualitative, 29, 30 
quantitative, 29, 36 
preparation of, 38 
purposes of, 29 
Gregory-Newton formula, 92 
Gregory-Newton method of interpolation. 
17, 20 

Hagen’s derivation of the normal law, 148 
Hall, Harry H., 141 
Halliday, D., 174 
Hardy, J. D., 47 
Harmonic analyzer, Chubb, 134 
General Radio Co., 140 
Henrici rolling sphere, 130 
Johnson, 139 
Marrison, 136 
mechanical, 134 
nonmechanical, 135 
Wente, 137 
Haynes, F. B., 98 
Haynes, I. C., 98 
Hecht. S., 45, 51, 174 
Henrici harmonic analyzer, 130 
Herrington, L. P., 293 

Index of correlation, 287 
Integration, 85 
average ordinate method, 101 
cut-and-wcigh method, 103 
graphical methods, 98 
photoelectric method, 103 
polar planimeter method, 98 
Simpson’s % rule, 95, 97 
Simpson 's % rule, 95, 97 
tabular methods, 94 
trapezoidal rule, 94, 97 
Weddle’s rule, 96, 97 
Interpolation, 16 
equation method, 18 
graph method, 16 
Gregory-Newton method, 17 
Lagrange method, 20 
proportional part method, 16 
Taylor’s series method, 23 
Item difference method of smoothing, 7 
Item differences, 7, 15 
Items in tables, 5 

Jaeger, F. M., S, 9, 10 
Johnson, V. O., 139 

harmonic analyzer, 139 

Kerchncr, R. H., 109, 124 
Kincer, J. B., 32 

Lagrange method of interpolation, 20 
Least count, 147 
Least squares, 141 
basis of, 163 
equations, 238 

applied to smoothing data, 251 
closeness of fit of, 260 
for relations other than power series, 
255 

linear, 239, 246, 258 
nonlinear, 245 
parabolic, 250 

probable errors of the constants of, 249 
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Least squares, equations ( continued) 
shortened computations for, 76, 243 
the polynomial, 252 
the sine curve, 256 
method of smoothing, 7, 251 
Leland, O. M., 338 
Lewis, B., 268 
Line of regression, 284, 286 
Lipka, J., 65, 91, 129, 338 
Logarithmic graph paper, 36 
Lowan, A. N., 96 


Marrison, W. A., 136 
harmonic analyzer, 136 
Marshall, W. C., 338 
Matuschak, Margaret, 252, 337 
Means, arithmetic, see Arithmetic means 
geometric, 146 
grand, 195 
inconsistent, 197 
root mean square, 146 
Mechanical devices, for differentiation, 89, 
91 

for Fourier series analysis, 130 
for integration, 98 
Median, 146 
Mellor, J. W., 338 
Merriman, M., 338 

Methods, of adjustment of conditioned 


measurements, 216 

of computing correlation coefficients, 275, 
276, 285 

of computing Fourier series coefficients, 
124, 130 

of computing least squares equations, 239 
of computing means, 168, 194 
of differentiation, 85 

of evaluating arbitrary constants, 64, 238 
of integration, 94 
of interpolation, 16 
of smoothing, 7 
Meyers, C. H., 73 
Michelson, A. A., 185 
Miller, D. C., 134, 257 
Mills, F. C., 338 
Mode, 146 

Modulus of precision, 151, 157; see also Pre¬ 
cision indexes 
Montgomery, H. G\, 137 


Nomogram, 37 

Non-harmonic periodic functions, see Pc- 
riodic functions, non-harmonic 
Normal equations, 217 
Normal frequency distribution, 140 
Hagen’s derivation of, 148 
justification of, 175 
limitations of, 171 
normalization of, 155 
tabular representations of, 159 
Normal method of finding dy/dx, 87 
Normality of a distribution, qualitative 
tests for, 177 

quantitative tests for, 1 S 2 


Ogive curve, 179 
Usborne, N. S., 73, 268 


Palmer, A. D„ 338 
Pearson, F., 185 
Hearson, K., 184, 338 

product moment formula, 275 


Pease, F. G., 185 

Periodic functions, harmonic, see Fourier 
series 

non-harmonic, 294 
analysis of, 294 

determination of amplitudes of, 304 
determination of periods of, 298 
determination of phase constants of. 
304 

Photoelectric method, of Fourier series anal- 
ysis, 136 

of integration, 103 
Physical slope, 87 
Pirenne, M. H., 45, 174 
Plane of regression, 288 
Planimeter, 160 
hatchet, 98 
polar, 98 

Poisson frequency distribution law, 174 
Polar graph paper, 36 
Polar planimeter, 98 

Precision indexes, of adjusted observations, 
229 

of arbitrary constants, 79, 249 
of correlation coefficients, 281 
of equally weighted measurements, 157 
quantitative evaluation of, 160 
relative effectiveness of, 168 
short method of computing, 168 
of grand means, 195 
of means, 193 
of precision indexes, 196 
of unequally weighted measurements, 

189 

short method of computing, 194 
propagation of, 205 

in planning experiments, 212 
law of, 208 

Probability coefficient, 149, 157, 160 
Probability graph paper, 36, 177, 181 
Probability of occurrence of a deviation be¬ 
tween limits, 151, 160 
Probable error, 157; see also Precision in¬ 
dexes 

Product moment formula, 275 
Propagation of precision indexes, see Preci¬ 
sion indexes, propagation of 
Proportional part method of interpolation, 
16, 18 

Pugh, E. M., 253 

Qualitative graphs, 29, 30 
Qualitative tables, 2 

Qualitative tests for normality of a fre¬ 
quency distribution, 177, 182 
Quantitative graphs, 29, 36 
Quantitative test for normality of a fre¬ 
quency distribution, 182 
Quincunx, 153 

Rational equations, 56 
Rectangular graph paper, 36, 41 
Regression curve. 287 
Regression lines, 284 
Regression plane, 288 
Robinson, G., 16, 274, 338 
Roebuck, J. R., 20, 27, 84 
Roeser, W. F.. 83 
Root mean square mean, 146 
Rossini. F. I)., 197, 198, 338 
Rounding off numbers, 13 
Running, T. R., 65, 129, 338 
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Satterly, 338 
Sears, F. W., 98 

Secant method of finding dy/dx, 90 
Selected-points method of finding equa¬ 
tions, 68, 77, 315 
Semi-log graph paper, 36 
Series, Fourier, see Fourier series 
Shaler, S., 45, 174 
Shea, J. D., 252, 337 
Significant figures, 11, 79 
Simons, H. P., 89 
Simpson’s 3^ rule, 95, 97 
Simpson’s % rule, 95, 97 
Skewness, 182 

Slope of a curve, determination of, see Dif¬ 
ferentiation 
geometric, 87 
physical, 87 
Smoothing, 6 

graphical method, 7 
item difference method, 7 
least-squares method, 7, 251 
Squint test for smoothness of a curve, 49, 88 
Standard deviation, 157; see also Precision 
indexes 

Standard error of estimate, 273 
Statistical tables, 2, 4 
Stevens, J. S., 338 **' 

Stimson, H. F., 268 

Straight-line graph method of finding equa¬ 
tions, 64, 65 
Stub of a table, 5 

Successive approximations method of find¬ 
ing equations, 76 

Tables, 1 

advantages of, 2 
functional, 2, 6 
qualitative, 2 
statistical, 2, 4 
types of, 2 

Tabular differences, 7, 15 
Tabular methods, of differentiation, 92 
of integration, 94 


Tabular methods, of obtaining Fourier 
series coefficients, 124 
of testing the suitability of an empirical 
equation, 60 

Tabulation, abbreviated forms of, 13; see 
also Tables 

Tangent method of finding dy/dx, 87 
Tangentmeter, 89 
Taylor, H. O., 129 

Taylor’s series method of interpolation, 23 
Tests, for consistency of means, 198 

for normality of a frequency distribution, 
177, 182 

for suitability of an assumed frequency 
distribution, 182 

for suitability of an empirical equation, 
58, 60 

Title of a table, 4 
Trapezoidal rule, 94, 97 
Trilinear graph paper, 37 
Tuckerman, L. B., 261, 338 
Tuttle, L„ 338 

Von Elbe, G., 268 

Watson, E. M., 55 
Weddle’s rule, 96, 97 
Weights, 58, 189 
and precision indexes, 191 
implied by a change of variables, 247 
Weld, L. G., 338 
Wensel, H. T., 261, 338 
Wente, E. C., 137 

harmonic analyzer, 137 
Whittaker, E. T., 16, 274, 338 
Woodward, It. S., 338 
Worthing, A. G., 27, 83, 239, 269 

x-interval, choice of, 6 

Yoe, J. H., 337 

z-function, Fisher’s, 281 

Zero-sum method of finding equations, 73 



ANSWERS TO PROBLEMS 


Chapter I, p. 26 

6. 0.43, 0.69. 6. 0.460, 0.348. *7. 0.147. 

Chapter HI, p. 83 

1 . y = 1.0003e-° 1815 ' day , 0.1815 day" 1 , 3.82 day*. 
3. p/ P0 = (T/To) 1 ' 200 . 


2. 12.3, 9.9, 8.5. 


Chapter IV, p. 106 
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1. y — - tt 


Chapter V, p. 146 
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6- y = —-- cos 0 - - cos 26 - — 0 - cos 39 
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75 “ cos 50-- - cos 60 — -r - cos 70 — 
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_ _ ** 

^ \/3tt ' m 2 [_ 4 

9. 6.37 sin (50 - 145.9°). 


rax . . 

sin — sin md 4- I 2 cos 


( rax \ 

2 cos ——II cos mO ; ra, 


odd only 


6. 43 X 10" 6 , 7.1 X 10" 6 . 
8. 9 X 10“M, 7.8 X 10M 


Chapter VI, p. 166 

7. 0.162, 0.0325. 

*, 99.0%. 
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ANSWERS TO PROBLEMS 


Chapter VII, p. 187 

1. 0.0008s', 0 . 00104 ', 0.0013i', O.OOI 85 '. 2 . 0.098 sec, 0.116 sec, 0.144 sec, 

0.204 sec. 6 . 52.49 °F, 0.9 F°, 1.4 F°, 1.9 F°, 5.5%, 51.58° F < T < 53.40° F. 
7. 30% to 40%, depending on details of procedure. 

Chapter VIII, p. 203 

1. 9.98 dt 0.03 gm. 3. (a, and a p ) 273.150 db 0.005° K, (a v ) 273.154 ± 0.008° K, 
(ocp) 273.143 dz 0.004° K. 

Chapter IX, p. 214 

1. 0.06 mm. 3. 0.4%, 3.0%, 1.0%, 2.5%. 5. 0.5K°, 2.2K°, 6.5K°. 

7. 273.45 ± 0.06 mm, 0.05107 ± 0.00007 mm 2 , 219.1 ± 0.3 mm 2 , 19.23 ± 0.03 
gm/cm 3 . 8 . Assume the two 80°45'30" readings to be independent, 1.66693 ± 
0.00005. 9. 0.1946 ± 0.0003, 0.01458 ± 0.00006. 

Chapter X, p. 236 

1. 100.7 ft, 500.3 ft, 151.1 ft, 79.9 ft, 1.4 ft. 2. 60°9.6', 60°0.4', 59°50.0'. 
3. 0.065 mm, 0.216 mm, 0.256 mm. 4. 0.2720 cal/(gmC°), 0.1918 cal/(gm C°), 
1.418. 6 . 8,030 ± 170 cal, 15,300 ± 170 cal. 

Chapter XI, p. 266 

I. 6.47 X 10 -27 erg sec. 2. a r = 36,606.73 X 10 ~ 7 K°~ l -f 133.72 X 10 “ 7 

p/ (m-Hg K°), 273.174 ± .002° K. 8. a = 1.00643 cal/(gm C°), b = -495.5 X 10 " 6 
cal/(gm C° 2 ), c = +8.371 X 10 ~ 6 cal/(gm C° 3 ), d = -0.03398 X 10 “ 6 cal/(gm C 04 ). 

9 - log = -6.58 4- 374 f A // = -86,100 K° R. 

II. 78°42', 19°55'. 

Chapter XII, p. 291 

1. 93%. 2. 97%, less than 1%, 99.5%. 3. 91%. 
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